00010000:02000000:44.0F:1550079885.402568:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.18@o2ib6 (stopping)
00010000:02000000:9.0F:1550079885.414127:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.17.5@o2ib6 (stopping)
00010000:02000000:9.0:1550079885.435953:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.1@o2ib6 (stopping)
00010000:02000000:19.0F:1550079885.562436:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.20@o2ib4 (stopping)
00010000:02000000:30.0F:1550079885.757452:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.18@o2ib6 (stopping)
00010000:02000000:30.0:1550079885.785642:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.15@o2ib4 (stopping)
00010000:02000000:30.0:1550079885.914837:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.21@o2ib6 (stopping)
00010000:02000000:9.0:1550079885.944176:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.58@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.048395:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.52@o2ib4 (stopping)
00010000:02000000:19.0:1550079886.092917:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.114.1@o2ib4 (stopping)
00010000:02000000:9.0:1550079886.158229:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.36@o2ib4 (stopping)
00000100:00080000:23.0F:1550079886.330878:0:7272:0:(pinger.c:248:ptlrpc_pinger_process_import()) fir-MDT0000-mdtlov_UUID->fir-MDT0002_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:23.0:1550079886.330882:0:7272:0:(recover.c:58:ptlrpc_initiate_recovery()) fir-MDT0002_UUID: starting recovery
00000100:00080000:23.0:1550079886.330883:0:7272:0:(import.c:677:ptlrpc_connect_import()) ffff9cb4fe587800 fir-MDT0002_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:23.0:1550079886.330886:0:7272:0:(import.c:523:import_select_connection()) fir-MDT0002-osp-MDT0000: connect to NID 0@lo last attempt 64839
00000100:00080000:23.0:1550079886.330888:0:7272:0:(import.c:523:import_select_connection()) fir-MDT0002-osp-MDT0000: connect to NID 10.0.10.52@o2ib7 last attempt 64814
00000100:00080000:23.0:1550079886.330892:0:7272:0:(import.c:591:import_select_connection()) fir-MDT0002-osp-MDT0000: Connection changing to fir-MDT0002 (at 10.0.10.52@o2ib7)
00000100:00080000:23.0:1550079886.330894:0:7272:0:(import.c:599:import_select_connection()) fir-MDT0002-osp-MDT0000: import ffff9cb4fe587800 using connection 10.0.10.52@o2ib7/10.0.10.52@o2ib7
00000100:00080000:10.0F:1550079886.331086:0:20311:0:(import.c:1276:ptlrpc_connect_interpret()) ffff9cb4fe587800 fir-MDT0002_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:10.0:1550079886.331092:0:20311:0:(import.c:1323:ptlrpc_connect_interpret()) recovery of fir-MDT0002_UUID on 10.0.10.52@o2ib7 failed (-19)
00010000:02000000:19.0:1550079886.389734:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.18@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.449534:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.43@o2ib4 (stopping)
00010000:02000000:9.0:1550079886.508328:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.13@o2ib6 (stopping)
00010000:02000000:9.0:1550079886.509857:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.63@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.529558:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.30@o2ib4 (stopping)
00010000:02000000:9.0:1550079886.545559:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.29@o2ib6 (stopping)
00010000:02000000:9.0:1550079886.567407:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.11@o2ib6 (stopping)
00010000:02000000:9.0:1550079886.568224:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.1@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.584796:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.6@o2ib6 (stopping)
00010000:02000000:9.0:1550079886.647482:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.19.1@o2ib6 (stopping)
00010000:02000000:19.0:1550079886.674150:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.4@o2ib4 (stopping)
00010000:02000000:9.0:1550079886.725975:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.32@o2ib6 (stopping)
00010000:02000000:6.0F:1550079886.725977:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.19.5@o2ib6 (stopping)
00010000:02000000:30.0:1550079886.761184:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.4@o2ib6 (stopping)
00010000:02000000:19.0:1550079886.782278:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.22@o2ib4 (stopping)
00010000:02000000:9.0:1550079886.792886:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.16.3@o2ib6 (stopping)
00010000:02000000:9.0:1550079886.813807:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.12.36@o2ib6 (stopping)
00010000:02000000:9.0:1550079886.833903:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.13@o2ib6 (stopping)
00010000:02000000:30.0:1550079886.854114:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.3@o2ib6 (stopping)
00010000:02000000:44.0:1550079886.857231:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.35@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.868762:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.32@o2ib6 (stopping)
00010000:02000000:44.0:1550079886.936593:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.71@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.941536:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.66@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.952125:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.65@o2ib4 (stopping)
00010000:02000000:44.0:1550079886.963202:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.112.16@o2ib4 (stopping)
00010000:02000000:44.0:1550079887.011322:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.34@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.014026:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.10@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.058657:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.28.5@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.125305:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.8@o2ib4 (stopping)
00010000:02000000:9.0:1550079887.149205:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.25@o2ib6 (stopping)
00010000:02000000:30.0:1550079887.158147:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.23.2@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.195893:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.1@o2ib6 (stopping)
00010000:02000000:30.0:1550079887.230908:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.33@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.236255:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.9@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.254940:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.7.24@o2ib6 (stopping)
00010000:02000000:30.0:1550079887.264728:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.9@o2ib4 (stopping)
00010000:02000000:9.0:1550079887.266343:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.5@o2ib4 (stopping)
00010000:02000000:9.0:1550079887.266384:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.6@o2ib6 (stopping)
00010000:02000000:30.0:1550079887.318406:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.17.20@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.324220:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.34@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.340690:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.7.6@o2ib6 (stopping)
00010000:02000000:30.0:1550079887.344063:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.14@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.431707:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.12.5@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.450077:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.22@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.495458:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.29@o2ib6 (stopping)
00010000:02000000:19.0:1550079887.539082:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.32@o2ib4 (stopping)
00010000:02000000:9.0:1550079887.546739:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.26@o2ib6 (stopping)
00010000:02000000:44.0:1550079887.591170:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.9@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.624938:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.23@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.674777:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.32@o2ib6 (stopping)
00010000:02000000:19.0:1550079887.791298:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.27@o2ib4 (stopping)
00010000:02000000:44.0:1550079887.798320:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.17.16@o2ib6 (stopping)
00010000:02000000:19.0:1550079887.806098:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.27@o2ib4 (stopping)
00010000:02000000:45.0F:1550079887.892732:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.18.23@o2ib6 (stopping)
00010000:02000000:14.0F:1550079887.948847:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.32@o2ib4 (stopping)
00010000:02000000:14.0:1550079887.950702:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.7@o2ib6 (stopping)
00010000:02000000:9.0:1550079887.972316:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.16@o2ib4 (stopping)
00010000:02000000:9.0:1550079888.015039:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.6@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.051516:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.36@o2ib4 (stopping)
00010000:02000000:44.0:1550079888.052425:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.27@o2ib4 (stopping)
00010000:02000000:14.0:1550079888.114797:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.70@o2ib4 (stopping)
00010000:02000000:9.0:1550079888.116373:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.5@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.137176:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.14@o2ib6 (stopping)
00010000:02000000:44.0:1550079888.138933:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.25@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.148148:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.24@o2ib6 (stopping)
00010000:02000000:44.0:1550079888.156810:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.11@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.158266:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.36@o2ib6 (stopping)
00010000:02000000:22.0F:1550079888.167113:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.59@o2ib4 (stopping)
00010000:02000000:19.0:1550079888.167122:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.19@o2ib4 (stopping)
00010000:02000000:6.0:1550079888.174826:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.28@o2ib6 (stopping)
00010000:02000000:6.0:1550079888.177826:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.24@o2ib6 (stopping)
00010000:02000000:6.0:1550079888.183078:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.32@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.211960:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.8@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.218897:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.15@o2ib6 (stopping)
00010000:02000000:12.0F:1550079888.220252:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.9@o2ib6 (stopping)
00010000:02000000:12.0:1550079888.224633:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.1@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.225676:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.55@o2ib4 (stopping)
00010000:02000000:38.0F:1550079888.225798:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.7@o2ib6 (stopping)
00010000:02000000:45.0:1550079888.364788:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.12@o2ib6 (stopping)
00010000:02000000:19.0:1550079888.385304:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.5@o2ib4 (stopping)
00010000:02000000:38.0:1550079888.401903:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.22@o2ib4 (stopping)
00010000:02000000:45.0:1550079888.416696:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.7@o2ib4 (stopping)
00010000:02000000:12.0:1550079888.418535:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.70@o2ib4 (stopping)
00010000:02000000:12.0:1550079888.434984:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.13@o2ib4 (stopping)
00010000:02000000:7.0F:1550079888.442246:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.51@o2ib4 (stopping)
00010000:02000000:38.0:1550079888.468140:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.29@o2ib4 (stopping)
00010000:02000000:38.0:1550079888.505087:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.19.4@o2ib6 (stopping)
00010000:02000000:12.0:1550079888.507584:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.7.20@o2ib6 (stopping)
00010000:02000000:12.0:1550079888.529217:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.15@o2ib6 (stopping)
00010000:02000000:12.0:1550079888.534249:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.30@o2ib4 (stopping)
00010000:02000000:45.0:1550079888.550022:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.52@o2ib4 (stopping)
00010000:02000000:45.0:1550079888.578471:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.9@o2ib6 (stopping)
00010000:02000000:12.0:1550079888.679818:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.4@o2ib6 (stopping)
00010000:02000000:38.0:1550079888.695570:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.36@o2ib6 (stopping)
00010000:02000000:45.0:1550079888.714635:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.10@o2ib6 (stopping)
00010000:02000000:38.0:1550079888.722921:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.20@o2ib6 (stopping)
00010000:02000000:9.0:1550079888.759222:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.17.3@o2ib6 (stopping)
00010000:02000000:12.0:1550079888.772943:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.51@o2ib4 (stopping)
00010000:02000000:9.0:1550079888.774370:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.27@o2ib6 (stopping)
00010000:02000000:7.0:1550079888.786254:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.67@o2ib4 (stopping)
00010000:02000000:9.0:1550079888.807498:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.64@o2ib4 (stopping)
00010000:02000000:12.0:1550079888.810444:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.16@o2ib4 (stopping)
00010000:02000000:30.0:1550079888.812455:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.12@o2ib6 (stopping)
00010000:02000000:30.0:1550079888.822765:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.11@o2ib4 (stopping)
00010000:02000000:30.0:1550079889.036573:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.30@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.060039:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.17.29@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.068975:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.13.12@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.096598:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.67@o2ib4 (stopping)
00010000:02000000:12.0:1550079889.121783:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.26@o2ib6 (stopping)
00010000:02000000:30.0:1550079889.137383:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.114.2@o2ib4 (stopping)
00010000:02000000:9.0:1550079889.198010:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.39@o2ib4 (stopping)
00010000:02000000:9.0:1550079889.238653:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.37@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.289087:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.44@o2ib4 (stopping)
00010000:02000000:12.0:1550079889.294807:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.4.9@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.330168:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.4@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.347353:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.12@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.378638:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.13.18@o2ib6 (stopping)
00010000:02020000:3.0F:1550079889.421870:0:39190:0:(ldlm_resource.c:1208:__ldlm_namespace_free()) 0-0: Forced cleanup waiting for fir-MDT0000-osp-MDT0002 namespace with 1 resources in use, (rc=-110)
00010000:02000000:30.0:1550079889.471787:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.27.18@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.587356:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.11@o2ib6 (stopping)
00010000:02000000:7.0:1550079889.593284:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.3@o2ib4 (stopping)
00000001:00080000:22.0:1550079889.625686:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596951 is committed
00000001:00080000:22.0:1550079889.625694:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596947 is committed
00000001:00080000:22.0:1550079889.625703:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596937 is committed
00000001:00080000:22.0:1550079889.625716:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596920 is committed
00000001:00080000:22.0:1550079889.625724:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596909 is committed
00000001:00080000:22.0:1550079889.625731:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596900 is committed
00000001:00080000:22.0:1550079889.625733:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596898 is committed
00000001:00080000:22.0:1550079889.625741:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596886 is committed
00000001:00080000:22.0:1550079889.625757:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596863 is committed
00000001:00080000:22.0:1550079889.625789:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596814 is committed
00000001:00080000:22.0:1550079889.625793:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596806 is committed
00000001:00080000:22.0:1550079889.625794:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596805 is committed
00000001:00080000:22.0:1550079889.625807:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596785 is committed
00000001:00080000:22.0:1550079889.625831:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596746 is committed
00010000:02000000:9.0:1550079889.625841:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.29.2@o2ib6 (stopping)
00010000:02000000:9.0:1550079889.646844:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.11@o2ib6 (stopping)
00010000:02000000:12.0:1550079889.675134:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.17@o2ib4 (stopping)
00010000:02000000:4.0F:1550079889.732181:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.36@o2ib6 (stopping)
00010000:02000000:7.0:1550079889.757307:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.113.5@o2ib4 (stopping)
00010000:02000000:45.0:1550079889.923973:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.21@o2ib6 (stopping)
00010000:02000000:45.0:1550079890.084197:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.14@o2ib6 (stopping)
00010000:02000000:45.0:1550079890.153477:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.19@o2ib6 (stopping)
00000004:00000080:4.0:1550079890.176989:0:21336:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200002f1b:0x20a:0x0] from 18446744073709551615 #0
00000004:00000080:4.0:1550079890.178995:0:21336:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200002f1b:0x205:0x0] from 18446744073709551615 #0
00000004:00000080:4.0:1550079890.182291:0:21336:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000046ff:0xcc:0x0] from 18446744073709551615 #0
00010000:02000000:45.0:1550079890.182794:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.4.24@o2ib6 (stopping)
00000004:00000080:4.0:1550079890.185078:0:21336:0:(mdt_handler.c:6431:mdt_iocontrol()) handling ioctl cmd 0x424066b3
00000004:00000080:4.0:1550079890.185089:0:21336:0:(mdd_device.c:1763:mdd_changelog_clear()) fir-MDD0000: Purge request: id=1, endrec=1475529268
00000040:00080000:4.0:1550079890.185099:0:21336:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x92:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0]
00000004:00000080:4.0:1550079890.185104:0:21336:0:(mdd_device.c:1736:mdd_changelog_clear_cb()) Rewriting changelog user 1 endrec to 1475529268
00000004:00000080:4.0:1550079890.185115:0:21336:0:(mdd_device.c:1801:mdd_changelog_clear()) fir-MDD0000: Purging changelog entries up to 1475529268
00000040:00080000:4.0:1550079890.185145:0:21336:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x6241:0x1:0x0]:0 at index 23276 of catalog [0x5:0xa:0x0]
00010000:02000000:4.0:1550079890.375236:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.20@o2ib6 (stopping)
00010000:02000000:4.0:1550079890.525809:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.15@o2ib4 (stopping)
00010000:02000000:45.0:1550079890.538441:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.23@o2ib4 (stopping)
00010000:02000000:7.0:1550079890.597532:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.4@o2ib4 (stopping)
00010000:02000000:30.0:1550079890.611654:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.47@o2ib4 (stopping)
00010000:02000000:30.0:1550079890.622398:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.13@o2ib4 (stopping)
00010000:02000000:45.0:1550079890.712146:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.27.26@o2ib6 (stopping)
00000040:00080000:4.0:1550079890.724791:0:21336:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3080, 168 off553232
00000001:00080000:4.0:1550079890.724794:0:21336:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754596983
00000040:00080000:4.0:1550079890.726591:0:21608:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3081, 168 off553400
00010000:02000000:45.0:1550079890.729221:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.10@o2ib6 (stopping)
00010000:02000000:4.0:1550079890.789812:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.14@o2ib4 (stopping)
00010000:02000000:4.0:1550079890.825362:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.2@o2ib6 (stopping)
00010000:02000000:4.0:1550079890.948077:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.3@o2ib4 (stopping)
00010000:02000000:30.0:1550079891.011915:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.31.10@o2ib6 (stopping)
00010000:02000000:45.0:1550079891.012229:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.31@o2ib6 (stopping)
00010000:02000000:4.0:1550079891.039042:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.21@o2ib6 (stopping)
00010000:02000000:45.0:1550079891.063739:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.12@o2ib6 (stopping)
00010000:02000000:45.0:1550079891.092273:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.7@o2ib6 (stopping)
00010000:02000000:45.0:1550079891.125137:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.50@o2ib4 (stopping)
00010000:02000000:30.0:1550079891.150794:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.9@o2ib4 (stopping)
00010000:02000000:4.0:1550079891.227972:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.35@o2ib4 (stopping)
00010000:02000000:4.0:1550079891.295100:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.40@o2ib4 (stopping)
00010000:02000000:30.0:1550079891.300624:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.108.17@o2ib4 (stopping)
00010000:02000000:4.0:1550079891.342501:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.113.6@o2ib4 (stopping)
00010000:02000000:45.0:1550079891.355959:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.16.2@o2ib6 (stopping)
00010000:02000000:30.0:1550079891.388840:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.55@o2ib4 (stopping)
00010000:02000000:30.0:1550079891.432121:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.13@o2ib6 (stopping)
00010000:02000000:30.0:1550079891.462229:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.13.24@o2ib6 (stopping)
00010000:02000000:4.0:1550079891.625120:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.33@o2ib6 (stopping)
00010000:02000000:45.0:1550079891.631337:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.21@o2ib4 (stopping)
00010000:02000000:45.0:1550079891.717599:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.20@o2ib4 (stopping)
00010000:02000000:45.0:1550079891.762818:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.13@o2ib6 (stopping)
00010000:02000000:4.0:1550079891.880643:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.8@o2ib6 (stopping)
00010000:02000000:7.0:1550079891.981708:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.1@o2ib4 (stopping)
00010000:02000000:45.0:1550079891.982450:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.31@o2ib6 (stopping)
00010000:02000000:45.0:1550079892.070762:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.2@o2ib6 (stopping)
00010000:02000000:45.0:1550079892.482038:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.25@o2ib4 (stopping)
00010000:02000000:45.0:1550079892.733293:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.25@o2ib6 (stopping)
00010000:02000000:45.0:1550079892.814153:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.54@o2ib4 (stopping)
00010000:02000000:45.0:1550079892.939901:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.27@o2ib6 (stopping)
00010000:02000000:38.0:1550079892.973974:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.17@o2ib6 (stopping)
00010000:02000000:38.0:1550079893.009217:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.35@o2ib6 (stopping)
00010000:02000000:4.0:1550079893.108936:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.33@o2ib6 (stopping)
00000004:00000080:44.0:1550079893.181217:0:21797:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200002f1b:0x20c:0x0] from 18446744073709551615 #0
00000004:00000080:44.0:1550079893.182689:0:21797:0:(mdt_handler.c:6431:mdt_iocontrol()) handling ioctl cmd 0x424066b3
00000004:00000080:44.0:1550079893.182704:0:21797:0:(mdd_device.c:1763:mdd_changelog_clear()) fir-MDD0000: Purge request: id=1, endrec=1475529270
00000040:00080000:44.0:1550079893.182713:0:21797:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x92:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0]
00000004:00000080:44.0:1550079893.182720:0:21797:0:(mdd_device.c:1736:mdd_changelog_clear_cb()) Rewriting changelog user 1 endrec to 1475529270
00000004:00000080:44.0:1550079893.182731:0:21797:0:(mdd_device.c:1801:mdd_changelog_clear()) fir-MDD0000: Purging changelog entries up to 1475529270
00000040:00080000:44.0:1550079893.182765:0:21797:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x6241:0x1:0x0]:0 at index 23276 of catalog [0x5:0xa:0x0]
00010000:02000000:7.0:1550079893.280751:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.112.6@o2ib4 (stopping)
00010000:02000000:38.0:1550079893.318714:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.16@o2ib6 (stopping)
00010000:02000000:7.0:1550079893.356603:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.1@o2ib4 (stopping)
00010000:02000000:44.0:1550079893.513240:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.48@o2ib4 (stopping)
00010000:02000000:45.0:1550079893.529279:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.0.68@o2ib6 (stopping)
00010000:02000000:44.0:1550079893.665726:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.19@o2ib4 (stopping)
00010000:02000000:12.0:1550079893.681006:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.12@o2ib6 (stopping)
00010000:02000000:12.0:1550079893.684731:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.113.11@o2ib4 (stopping)
00010000:02000000:7.0:1550079893.752015:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.27@o2ib4 (stopping)
00010000:02000000:45.0:1550079893.777965:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.22@o2ib4 (stopping)
00010000:02000000:12.0:1550079893.800477:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.12.8@o2ib6 (stopping)
00010000:02000000:7.0:1550079893.881720:0:21799:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.57@o2ib4 (stopping)
00010000:02000000:12.0:1550079894.242974:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.58@o2ib4 (stopping)
00010000:02000000:45.0:1550079894.259542:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.112.3@o2ib4 (stopping)
00010000:02000000:45.0:1550079894.290507:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.14@o2ib4 (stopping)
00010000:02000000:45.0:1550079894.360014:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.114.4@o2ib4 (stopping)
00010000:02000000:45.0:1550079894.465019:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.16.8@o2ib6 (stopping)
00010000:02000000:45.0:1550079894.479384:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.27.16@o2ib6 (stopping)
00010000:02000000:38.0:1550079894.619770:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.22@o2ib4 (stopping)
00010000:02000000:12.0:1550079894.622488:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.8@o2ib4 (stopping)
00010000:02000000:12.0:1550079894.651541:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.24@o2ib4 (stopping)
00010000:02000000:12.0:1550079894.674173:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.33@o2ib6 (stopping)
00010000:02000000:9.0:1550079894.696650:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.26@o2ib6 (stopping)
00010000:02000000:12.0:1550079894.709825:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.4@o2ib4 (stopping)
00010000:02000000:9.0:1550079894.726879:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.11.5@o2ib6 (stopping)
00010000:02000000:9.0:1550079894.759220:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.16@o2ib4 (stopping)
00010000:02000000:45.0:1550079894.783160:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.5@o2ib4 (stopping)
00000040:00080000:38.0:1550079894.858156:0:21791:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3082, 200 off553600
00000001:00080000:22.0:1550079894.859836:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597164 is committed
00000001:00080000:22.0:1550079894.859840:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597163 is committed
00000001:00080000:22.0:1550079894.859842:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597162 is committed
00000001:00080000:22.0:1550079894.859847:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597158 is committed
00000001:00080000:22.0:1550079894.859857:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597144 is committed
00000001:00080000:22.0:1550079894.859867:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597138 is committed
00000001:00080000:22.0:1550079894.859874:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597126 is committed
00000001:00080000:22.0:1550079894.859880:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597119 is committed
00000001:00080000:22.0:1550079894.859896:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597095 is committed
00000001:00080000:22.0:1550079894.859897:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597094 is committed
00000001:00080000:22.0:1550079894.859924:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597057 is committed
00000001:00080000:22.0:1550079894.859939:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597036 is committed
00000001:00080000:22.0:1550079894.859962:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597007 is committed
00000001:00080000:22.0:1550079894.859978:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596985 is committed
00000001:00080000:22.0:1550079894.859983:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754596978 is committed
00000004:00080000:38.0:1550079894.864226:0:21791:0:(osp_object.c:1592:osp_create()) fir-OST002f-osc-MDT0000: Wrote last used FID: [0x1002f0000:0xc2ee5:0x0], index 47: 0
00000040:00080000:38.0:1550079894.864238:0:21791:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3083, 136 off553736
00010000:02000000:13.0F:1550079895.001021:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.34@o2ib6 (stopping)
00010000:02000000:27.0F:1550079895.017986:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.53@o2ib4 (stopping)
00010000:02000000:12.0:1550079895.073914:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.1@o2ib6 (stopping)
00010000:02000000:13.0:1550079895.077272:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.23.9@o2ib6 (stopping)
00000001:00080000:22.0:1550079895.099866:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597170 is committed
00000001:00080000:22.0:1550079895.099869:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597169 is committed
00000001:00080000:22.0:1550079895.099871:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597167 is committed
00000001:00080000:22.0:1550079895.099873:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597166 is committed
00010000:02000000:38.0:1550079895.139493:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.3@o2ib6 (stopping)
00000040:00080000:9.0:1550079895.144388:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3084, 168 off553904
00000001:00080000:9.0:1550079895.144391:0:21962:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597174
00000040:00080000:13.0:1550079895.150905:0:21804:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3085, 168 off554072
00000001:00080000:13.0:1550079895.150908:0:21804:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597180
00000040:00080000:9.0:1550079895.173288:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3086, 168 off554240
00000001:00080000:9.0:1550079895.173291:0:21962:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597189
00000040:00080000:12.0:1550079895.176934:0:21792:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x5fbe:0x0].3780, 64 off250176
00000004:00080000:12.0:1550079895.176937:0:21792:0:(osp_sync.c:1583:osp_sync_add_commit_cb()) fir-OST0013-osc-MDT0000: add commit cb at 64873837077150ns, next at 64874837076809ns, rc = 0
00000040:00080000:12.0:1550079895.176950:0:21792:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3087, 240 off554480
00010000:02000000:38.0:1550079895.180077:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.25@o2ib4 (stopping)
00010000:02000000:13.0:1550079895.192752:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.36@o2ib6 (stopping)
00010000:02000000:12.0:1550079895.290708:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.9@o2ib4 (stopping)
00010000:02000000:13.0:1550079895.397299:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.16@o2ib6 (stopping)
00010000:02000000:12.0:1550079895.423722:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.23@o2ib6 (stopping)
00010000:02000000:12.0:1550079895.426780:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.42@o2ib4 (stopping)
00010000:02000000:12.0:1550079895.429776:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.23.3@o2ib6 (stopping)
00010000:02000000:13.0:1550079895.441768:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.62@o2ib4 (stopping)
00010000:02000000:38.0:1550079895.447234:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.69@o2ib4 (stopping)
00010000:02000000:38.0:1550079895.469603:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.3@o2ib4 (stopping)
00010000:02000000:13.0:1550079895.476697:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.12@o2ib4 (stopping)
00010000:02000000:38.0:1550079895.476902:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.2.34@o2ib6 (stopping)
00010000:02000000:12.0:1550079895.527464:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.25@o2ib4 (stopping)
00010000:02000000:1.0F:1550079895.671244:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.3.27@o2ib6 (stopping)
00010000:02000000:16.0F:1550079895.821825:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.36@o2ib4 (stopping)
00010000:02000000:17.0F:1550079895.963837:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.24@o2ib6 (stopping)
00010000:02000000:16.0:1550079896.085815:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.18@o2ib4 (stopping)
00010000:02000000:16.0:1550079896.121453:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.13@o2ib4 (stopping)
00010000:02000000:27.0:1550079896.137448:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.21@o2ib4 (stopping)
00010000:02000000:38.0:1550079896.144633:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.114.13@o2ib4 (stopping)
00010000:02000000:27.0:1550079896.256359:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.47@o2ib4 (stopping)
00010000:02000000:16.0:1550079896.398985:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.34@o2ib4 (stopping)
00010000:02000000:17.0:1550079896.471645:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.42@o2ib4 (stopping)
00010000:02000000:37.0F:1550079896.535904:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.4.7@o2ib6 (stopping)
00010000:02000000:37.0:1550079896.709286:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.21@o2ib4 (stopping)
00010000:02000000:38.0:1550079896.751589:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.20@o2ib6 (stopping)
00010000:02000000:38.0:1550079896.839727:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.70@o2ib4 (stopping)
00010000:02000000:27.0:1550079896.890965:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.13@o2ib4 (stopping)
00000040:00080000:38.0:1550079896.894745:0:23770:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3088, 168 off554648
00010000:02000000:38.0:1550079896.899710:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.58@o2ib4 (stopping)
00000040:00080000:38.0:1550079896.904501:0:21791:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3089, 168 off554816
00000001:00080000:38.0:1550079896.904504:0:21791:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597274
00000040:00080000:38.0:1550079896.906348:0:23770:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3090, 168 off554984
00010000:02000000:37.0:1550079896.930159:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.8@o2ib6 (stopping)
00010000:02000000:38.0:1550079896.943821:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.20@o2ib4 (stopping)
00010000:02000000:38.0:1550079896.945881:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.56@o2ib4 (stopping)
00010000:02000000:38.0:1550079896.968921:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.9@o2ib6 (stopping)
00010000:02000000:30.0:1550079897.130921:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.21.9@o2ib6 (stopping)
00010000:02000000:37.0:1550079897.132843:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.64@o2ib4 (stopping)
00010000:02000000:30.0:1550079897.323257:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.18@o2ib4 (stopping)
00010000:02000000:16.0:1550079897.404280:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.29.5@o2ib6 (stopping)
00010000:02000000:30.0:1550079897.421329:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.115.5@o2ib4 (stopping)
00010000:02000000:30.0:1550079897.846122:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.21@o2ib6 (stopping)
00010000:02000000:16.0:1550079897.872945:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.6.2@o2ib6 (stopping)
00010000:02000000:16.0:1550079897.893114:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.16@o2ib6 (stopping)
00010000:02000000:30.0:1550079897.982356:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.112.13@o2ib4 (stopping)
00010000:02000000:38.0:1550079898.049011:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.16@o2ib4 (stopping)
00010000:02000000:16.0:1550079898.103970:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.27@o2ib6 (stopping)
00010000:02000000:37.0:1550079898.134793:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.4.17@o2ib6 (stopping)
00010000:02000000:16.0:1550079898.154236:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.54@o2ib4 (stopping)
00010000:02000000:37.0:1550079898.441135:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.3@o2ib6 (stopping)
00010000:02000000:16.0:1550079898.613283:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.113.8@o2ib4 (stopping)
00010000:02000000:37.0:1550079898.625019:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.28@o2ib4 (stopping)
00010000:02000000:38.0:1550079898.637227:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.70@o2ib4 (stopping)
00010000:02000000:16.0:1550079898.650025:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.54@o2ib4 (stopping)
00010000:02000000:16.0:1550079898.665138:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.27.8@o2ib6 (stopping)
00010000:02000000:37.0:1550079898.685458:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.25@o2ib6 (stopping)
00010000:02000000:37.0:1550079898.731617:0:21745:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.18@o2ib6 (stopping)
00010000:02000000:16.0:1550079898.930360:0:21351:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.37@o2ib4 (stopping)
00010000:02000000:44.0:1550079899.045918:0:21797:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.52@o2ib4 (stopping)
00010000:02000000:36.0F:1550079899.079982:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.25.32@o2ib6 (stopping)
00010000:02000000:36.0:1550079899.143836:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.112.5@o2ib4 (stopping)
00000040:00080000:11.0F:1550079899.191528:0:23768:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3091, 168 off555152
00000040:00080000:9.0:1550079899.202024:0:20811:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3092, 168 off555320
00000001:00080000:9.0:1550079899.202027:0:20811:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597417
00010000:02000000:36.0:1550079899.203752:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.28@o2ib6 (stopping)
00000040:00080000:9.0:1550079899.203935:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3093, 168 off555488
00010000:02000000:30.0:1550079899.232761:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.49@o2ib4 (stopping)
00010000:02000000:9.0:1550079899.338733:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.9.8@o2ib6 (stopping)
00010000:02000000:30.0:1550079899.407517:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.4.18@o2ib6 (stopping)
00010000:02000000:13.0:1550079899.463901:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.12.25@o2ib6 (stopping)
00010000:02000000:9.0:1550079899.566556:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.24@o2ib4 (stopping)
00000004:00080000:9.0:1550079899.754881:0:20704:0:(osp_sync.c:1583:osp_sync_add_commit_cb()) fir-OST0013-osc-MDT0000: add commit cb at 64878415020577ns, next at 64879415020126ns, rc = 0
00010000:02000000:30.0:1550079899.756832:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.8@o2ib4 (stopping)
00010000:02000000:9.0:1550079899.772960:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.26@o2ib6 (stopping)
00010000:02000000:36.0:1550079899.808169:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.21@o2ib4 (stopping)
00010000:02000000:9.0:1550079899.853436:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.18.19@o2ib6 (stopping)
00010000:02000000:9.0:1550079899.943447:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.28.12@o2ib6 (stopping)
00010000:02000000:30.0:1550079900.115511:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.44@o2ib4 (stopping)
00000001:00080000:22.0:1550079900.159434:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597450 is committed
00000001:00080000:22.0:1550079900.159437:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597449 is committed
00000001:00080000:22.0:1550079900.159439:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597448 is committed
00000001:00080000:22.0:1550079900.159441:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597447 is committed
00000001:00080000:22.0:1550079900.159444:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597444 is committed
00000001:00080000:22.0:1550079900.159446:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597442 is committed
00000001:00080000:22.0:1550079900.159447:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597441 is committed
00000001:00080000:22.0:1550079900.159449:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597440 is committed
00000004:00080000:22.0:1550079900.159453:0:20475:0:(osp_sync.c:1548:osp_sync_local_commit_cb()) fir-OST0013-osc-MDT0000: 1868 committed
00000001:00080000:22.0:1550079900.159462:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597431 is committed
00000004:00080000:39.0F:1550079900.159463:0:20703:0:(osp_sync.c:1135:osp_sync_process_queues()) 1 changes, 0 in progress, 0 in flight
00000001:00080000:22.0:1550079900.159470:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597419 is committed
00000001:00080000:22.0:1550079900.159478:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597409 is committed
00000004:00080000:39.0:1550079900.159486:0:20703:0:(osp_sync.c:985:osp_sync_process_record()) found record 10692404, 64, idx 3780, id 1866
00000001:00080000:22.0:1550079900.159497:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597384 is committed
00000001:00080000:22.0:1550079900.159504:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597373 is committed
00000001:00080000:22.0:1550079900.159510:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597364 is committed
00000001:00080000:22.0:1550079900.159517:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597355 is committed
00000001:00080000:22.0:1550079900.159519:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597353 is committed
00000001:00080000:22.0:1550079900.159528:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597342 is committed
00000001:00080000:22.0:1550079900.159565:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597281 is committed
00000001:00080000:22.0:1550079900.159569:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597276 is committed
00000001:00080000:22.0:1550079900.159607:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597216 is committed
00000004:00080000:22.0:1550079900.159627:0:20475:0:(osp_sync.c:1548:osp_sync_local_commit_cb()) fir-OST0013-osc-MDT0000: 1867 committed
00010000:02000000:30.0:1550079900.165496:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.29@o2ib4 (stopping)
00010000:02000000:36.0:1550079900.196984:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.2@o2ib6 (stopping)
00010000:02000000:27.0:1550079900.364596:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.113.14@o2ib4 (stopping)
00000004:00080000:27.0:1550079900.378503:0:20353:0:(osp_sync.c:564:osp_sync_interpret()) reply req ffff9cd4fe2aad00/2, rc 0, transno 5711178
00010000:02000000:17.0:1550079900.934792:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.17.15@o2ib6 (stopping)
00010000:02000000:36.0:1550079901.059314:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.55@o2ib4 (stopping)
00010000:02000000:30.0:1550079901.072718:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.47@o2ib4 (stopping)
00010000:02000000:36.0:1550079901.131867:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.102@o2ib7 (stopping)
00010000:02000000:28.0F:1550079901.131928:0:21336:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.102@o2ib7 (stopping)
00010000:02000000:40.0F:1550079901.131940:0:21840:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.102@o2ib7 (stopping)
00010000:02000000:16.0:1550079901.131942:0:21773:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.102@o2ib7 (stopping)
00010000:02000000:36.0:1550079901.131999:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.102@o2ib7 (stopping)
00010000:02000000:36.0:1550079901.132020:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.102@o2ib7 (stopping)
00010000:02000000:17.0:1550079901.385280:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.35@o2ib4 (stopping)
00010000:02000000:36.0:1550079901.389744:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.33@o2ib4 (stopping)
00010000:02000000:30.0:1550079901.569814:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.6@o2ib4 (stopping)
00010000:02000000:17.0:1550079901.726292:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.112.10@o2ib4 (stopping)
00010000:02000000:30.0:1550079901.815405:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.7.19@o2ib6 (stopping)
00010000:02000000:30.0:1550079901.824904:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.4@o2ib6 (stopping)
00010000:02000000:36.0:1550079901.825243:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.10@o2ib4 (stopping)
00000040:00080000:14.0:1550079901.830310:0:23770:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3094, 168 off555656
00000040:00080000:27.0:1550079901.841553:0:20534:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3095, 168 off555824
00000001:00080000:27.0:1550079901.841556:0:20534:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597578
00000040:00080000:11.0:1550079901.843768:0:23768:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3096, 168 off555992
00010000:00010000:20.0F:1550079902.033076:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4602e3a80/0x6bcd99f6a751ec05 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22443 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52acd7bd expref: 22443 pid: 21877 timeout: 0 lvb_type: 0
00010000:00010000:5.0F:1550079902.033668:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9f27590240/0x6bcd99f6a7f88060 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265625 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0a3e0d expref: 265633 pid: 20526 timeout: 62419 lvb_type: 0
00010000:00010000:5.0:1550079902.033681:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f27590240/0x6bcd99f6a7f88060 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265624 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0a3e0d expref: 265633 pid: 20526 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.034443:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265623
00000004:00000040:5.0:1550079902.034444:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.034446:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265624
00010000:00010000:5.0:1550079902.034447:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4157db600/0x6bcd99f6a7cd07ef lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265624 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff033e0d expref: 265632 pid: 21356 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.034451:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265623
00000020:00000040:5.0:1550079902.034452:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4157db600 with handle 0x6bcd99f6a7cd07ef from hash
00010000:00000040:5.0:1550079902.034453:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265622
00010000:00000040:5.0:1550079902.034454:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265623
00010000:00010000:5.0:1550079902.034455:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4157db600/0x6bcd99f6a7cd07ef lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265623 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff033e0d expref: 265632 pid: 21356 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.034459:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265622
00010000:00000040:5.0:1550079902.034459:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265621
00010000:00000040:5.0:1550079902.034460:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265629
00000020:00000040:5.0:1550079902.034461:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265631
00000001:00000040:5.0:1550079902.034463:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 4
00010000:00000040:20.0:1550079902.034564:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22442
00000004:00000040:20.0:1550079902.034566:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.034568:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd472530d80 with handle 0x6bcd99f6a71d85a4 from hash
00010000:00000040:20.0:1550079902.034570:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22441
00010000:00000040:20.0:1550079902.034571:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22442
00010000:00010000:20.0:1550079902.034573:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd472530d80/0x6bcd99f6a71d85a4 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22442 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a5d7bd expref: 22442 pid: 21431 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.034576:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22441
00010000:00000040:20.0:1550079902.034577:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22440
00010000:00000040:20.0:1550079902.034578:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22440
00000020:00000040:20.0:1550079902.034579:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22441
00000001:00000040:20.0:1550079902.034581:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 2
00010000:00000040:5.0:1550079902.035217:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265622
00000004:00000040:5.0:1550079902.035218:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.035219:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265623
00010000:00010000:5.0:1550079902.035221:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca44f79de80/0x6bcd99f6a795b170 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265623 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefc3e0d expref: 265631 pid: 21811 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.035224:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265622
00000020:00000040:5.0:1550079902.035226:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca44f79de80 with handle 0x6bcd99f6a795b170 from hash
00010000:00000040:5.0:1550079902.035227:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265621
00010000:00000040:5.0:1550079902.035228:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265622
00010000:00010000:5.0:1550079902.035229:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca44f79de80/0x6bcd99f6a795b170 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265622 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefc3e0d expref: 265631 pid: 21811 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.035232:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265621
00010000:00000040:5.0:1550079902.035233:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265620
00010000:00000040:5.0:1550079902.035234:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265628
00000020:00000040:5.0:1550079902.035235:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265630
00000001:00000040:5.0:1550079902.035236:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 5
00010000:00000040:20.0:1550079902.035546:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22441
00000004:00000040:20.0:1550079902.035547:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.035549:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc404483180 with handle 0x6bcd99f6a9767a31 from hash
00010000:00000040:20.0:1550079902.035550:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22440
00010000:00000040:20.0:1550079902.035551:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22441
00010000:00010000:20.0:1550079902.035553:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc404483180/0x6bcd99f6a9767a31 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22441 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e9dfbd expref: 22441 pid: 21752 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.035557:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22440
00010000:00000040:20.0:1550079902.035557:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22439
00010000:00000040:20.0:1550079902.035558:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22439
00000020:00000040:20.0:1550079902.035559:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22440
00000001:00000040:20.0:1550079902.035560:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 3
00010000:00000040:5.0:1550079902.035992:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265621
00000004:00000040:5.0:1550079902.035993:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.035994:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265622
00010000:00010000:5.0:1550079902.035996:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb457a38fc0/0x6bcd99f6a773a61c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265622 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef53e0d expref: 265630 pid: 21888 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.035999:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265621
00000020:00000040:5.0:1550079902.036000:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb457a38fc0 with handle 0x6bcd99f6a773a61c from hash
00010000:00000040:5.0:1550079902.036001:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265620
00010000:00000040:5.0:1550079902.036002:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265621
00010000:00010000:5.0:1550079902.036004:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb457a38fc0/0x6bcd99f6a773a61c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265621 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef53e0d expref: 265630 pid: 21888 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.036007:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265620
00010000:00000040:5.0:1550079902.036007:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265619
00010000:00000040:5.0:1550079902.036008:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265627
00000020:00000040:5.0:1550079902.036009:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265629
00000001:00000040:5.0:1550079902.036010:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 6
00010000:00000040:20.0:1550079902.036526:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22440
00000004:00000040:20.0:1550079902.036527:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.036530:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc44b9c3600 with handle 0x6bcd99f6a91f5259 from hash
00010000:00000040:20.0:1550079902.036531:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22439
00010000:00000040:20.0:1550079902.036532:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22440
00010000:00010000:20.0:1550079902.036534:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc44b9c3600/0x6bcd99f6a91f5259 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22440 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e2dfbd expref: 22440 pid: 21357 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.036537:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22439
00010000:00000040:20.0:1550079902.036538:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22438
00010000:00000040:20.0:1550079902.036538:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22438
00000020:00000040:20.0:1550079902.036539:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22439
00000001:00000040:20.0:1550079902.036540:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 4
00010000:00000040:5.0:1550079902.036762:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265620
00000004:00000040:5.0:1550079902.036764:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.036764:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265621
00010000:00010000:5.0:1550079902.036766:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9fe7640fc0/0x6bcd99f6a74abcbe lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265621 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feee3e0d expref: 265629 pid: 21346 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.036769:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265620
00000020:00000040:5.0:1550079902.036771:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9fe7640fc0 with handle 0x6bcd99f6a74abcbe from hash
00010000:00000040:5.0:1550079902.036772:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265619
00010000:00000040:5.0:1550079902.036773:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265620
00010000:00010000:5.0:1550079902.036774:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9fe7640fc0/0x6bcd99f6a74abcbe lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265620 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feee3e0d expref: 265629 pid: 21346 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.036777:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265619
00010000:00000040:5.0:1550079902.036778:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265618
00010000:00000040:5.0:1550079902.036778:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265626
00000020:00000040:5.0:1550079902.036779:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265628
00000001:00000040:5.0:1550079902.036780:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 7
00010000:00000040:20.0:1550079902.037504:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22439
00000004:00000040:20.0:1550079902.037505:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.037507:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb486a26c00 with handle 0x6bcd99f6a8eb3ab8 from hash
00010000:00000040:20.0:1550079902.037508:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22438
00010000:00000040:20.0:1550079902.037509:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22439
00010000:00010000:20.0:1550079902.037511:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb486a26c00/0x6bcd99f6a8eb3ab8 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22439 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52dbdfbd expref: 22439 pid: 21249 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.037514:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22438
00010000:00000040:20.0:1550079902.037515:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22437
00010000:00000040:20.0:1550079902.037515:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22437
00000020:00000040:20.0:1550079902.037516:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22438
00000001:00000040:20.0:1550079902.037517:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 5
00010000:00000040:5.0:1550079902.037537:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265619
00000004:00000040:5.0:1550079902.037538:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.037538:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265620
00010000:00010000:5.0:1550079902.037540:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb440242d00/0x6bcd99f6a7239d70 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265620 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee73e0d expref: 265628 pid: 21324 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.037543:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265619
00000020:00000040:5.0:1550079902.037545:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb440242d00 with handle 0x6bcd99f6a7239d70 from hash
00010000:00000040:5.0:1550079902.037546:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265618
00010000:00000040:5.0:1550079902.037547:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265619
00010000:00010000:5.0:1550079902.037548:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb440242d00/0x6bcd99f6a7239d70 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265619 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee73e0d expref: 265628 pid: 21324 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.037555:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265618
00010000:00000040:5.0:1550079902.037555:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265617
00010000:00000040:5.0:1550079902.037556:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265625
00000020:00000040:5.0:1550079902.037557:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265627
00000001:00000040:5.0:1550079902.037558:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 8
00010000:00000040:5.0:1550079902.038313:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265618
00000004:00000040:5.0:1550079902.038314:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.038315:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265619
00010000:00010000:5.0:1550079902.038316:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c57fb180/0x6bcd99f6a700cf96 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265619 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee03e0d expref: 265627 pid: 21836 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.038320:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265618
00000020:00000040:5.0:1550079902.038322:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3c57fb180 with handle 0x6bcd99f6a700cf96 from hash
00010000:00000040:5.0:1550079902.038323:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265617
00010000:00000040:5.0:1550079902.038323:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265618
00010000:00010000:5.0:1550079902.038324:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c57fb180/0x6bcd99f6a700cf96 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265618 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee03e0d expref: 265627 pid: 21836 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.038327:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265617
00010000:00000040:5.0:1550079902.038328:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265616
00010000:00000040:5.0:1550079902.038329:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265624
00000020:00000040:5.0:1550079902.038329:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265626
00000001:00000040:5.0:1550079902.038331:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 9
00010000:00000040:20.0:1550079902.038481:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22438
00000004:00000040:20.0:1550079902.038482:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.038484:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd499cc8240 with handle 0x6bcd99f6a8a3a185 from hash
00010000:00000040:20.0:1550079902.038485:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22437
00010000:00000040:20.0:1550079902.038486:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22438
00010000:00010000:20.0:1550079902.038488:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd499cc8240/0x6bcd99f6a8a3a185 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22438 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d4dfbd expref: 22438 pid: 21861 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.038491:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22437
00010000:00000040:20.0:1550079902.038492:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22436
00010000:00000040:20.0:1550079902.038493:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22436
00000020:00000040:20.0:1550079902.038494:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22437
00000001:00000040:20.0:1550079902.038495:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 6
00010000:00000040:5.0:1550079902.039083:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265617
00000004:00000040:5.0:1550079902.039084:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.039085:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265618
00010000:00010000:5.0:1550079902.039087:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd451e18d80/0x6bcd99f6a6d93781 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265618 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed93e0d expref: 265626 pid: 21725 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.039095:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265617
00000020:00000040:5.0:1550079902.039096:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd451e18d80 with handle 0x6bcd99f6a6d93781 from hash
00010000:00000040:5.0:1550079902.039097:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265616
00010000:00000040:5.0:1550079902.039098:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265617
00010000:00010000:5.0:1550079902.039099:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd451e18d80/0x6bcd99f6a6d93781 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265617 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed93e0d expref: 265626 pid: 21725 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.039103:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265616
00010000:00000040:5.0:1550079902.039103:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265615
00010000:00000040:5.0:1550079902.039104:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265623
00000020:00000040:5.0:1550079902.039105:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265625
00000001:00000040:5.0:1550079902.039106:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 10
00010000:00000040:20.0:1550079902.039461:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22437
00000004:00000040:20.0:1550079902.039462:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.039463:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46ee90900 with handle 0x6bcd99f6a866fd4c from hash
00010000:00000040:20.0:1550079902.039464:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22436
00010000:00000040:20.0:1550079902.039465:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22437
00010000:00010000:20.0:1550079902.039467:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46ee90900/0x6bcd99f6a866fd4c lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22437 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cddfbd expref: 22437 pid: 21855 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.039470:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22436
00010000:00000040:20.0:1550079902.039471:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22435
00010000:00000040:20.0:1550079902.039472:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22435
00000020:00000040:20.0:1550079902.039473:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22436
00000001:00000040:20.0:1550079902.039474:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 7
00010000:00000040:5.0:1550079902.039858:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265616
00000004:00000040:5.0:1550079902.039858:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.039859:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265617
00010000:00010000:5.0:1550079902.039865:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc45a23c140/0x6bcd99f6a6b614dc lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265617 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed23e0d expref: 265625 pid: 21866 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.039868:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265616
00000020:00000040:5.0:1550079902.039870:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc45a23c140 with handle 0x6bcd99f6a6b614dc from hash
00010000:00000040:5.0:1550079902.039871:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265615
00010000:00000040:5.0:1550079902.039872:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265616
00010000:00010000:5.0:1550079902.039873:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc45a23c140/0x6bcd99f6a6b614dc lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265616 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed23e0d expref: 265625 pid: 21866 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.039876:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265615
00010000:00000040:5.0:1550079902.039877:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265614
00010000:00000040:5.0:1550079902.039878:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265622
00000020:00000040:5.0:1550079902.039879:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265624
00000001:00000040:5.0:1550079902.039880:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 11
00010000:00000040:20.0:1550079902.040438:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22436
00000004:00000040:20.0:1550079902.040439:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.040440:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb263ea0480 with handle 0x6bcd99f6a81eafa1 from hash
00010000:00000040:20.0:1550079902.040441:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22435
00010000:00000040:20.0:1550079902.040442:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22436
00010000:00010000:20.0:1550079902.040444:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb263ea0480/0x6bcd99f6a81eafa1 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22436 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c6dfbd expref: 22436 pid: 20528 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.040447:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22435
00010000:00000040:20.0:1550079902.040448:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22434
00010000:00000040:20.0:1550079902.040449:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22434
00000020:00000040:20.0:1550079902.040450:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22435
00000001:00000040:20.0:1550079902.040451:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 8
00010000:00000040:5.0:1550079902.040632:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265615
00000004:00000040:5.0:1550079902.040633:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.040633:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265616
00010000:00010000:5.0:1550079902.040635:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46377dc40/0x6bcd99f6a67e37e3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265616 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecb3e0d expref: 265624 pid: 21067 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.040639:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265615
00000020:00000040:5.0:1550079902.040640:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46377dc40 with handle 0x6bcd99f6a67e37e3 from hash
00010000:00000040:5.0:1550079902.040641:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265614
00010000:00000040:5.0:1550079902.040642:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265615
00010000:00010000:5.0:1550079902.040643:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46377dc40/0x6bcd99f6a67e37e3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265615 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecb3e0d expref: 265624 pid: 21067 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.040646:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265614
00010000:00000040:5.0:1550079902.040647:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265613
00010000:00000040:5.0:1550079902.040648:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265621
00000020:00000040:5.0:1550079902.040648:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265623
00000001:00000040:5.0:1550079902.040649:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 12
00010000:00000040:5.0:1550079902.041407:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265614
00000004:00000040:5.0:1550079902.041408:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.041409:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265615
00010000:00010000:5.0:1550079902.041410:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd40870a1c0/0x6bcd99f6a88ca318 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265615 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff39460d expref: 265623 pid: 20610 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.041413:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265614
00000020:00000040:5.0:1550079902.041415:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd40870a1c0 with handle 0x6bcd99f6a88ca318 from hash
00010000:00000040:5.0:1550079902.041416:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265613
00010000:00000040:5.0:1550079902.041416:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265614
00010000:00000040:20.0:1550079902.041417:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22435
00000004:00000040:20.0:1550079902.041418:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00010000:00010000:5.0:1550079902.041418:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd40870a1c0/0x6bcd99f6a88ca318 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265614 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff39460d expref: 265623 pid: 20610 timeout: 62414 lvb_type: 0
00000020:00000040:20.0:1550079902.041420:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d9de960c0 with handle 0x6bcd99f6a7d92aad from hash
00010000:00000040:20.0:1550079902.041421:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22434
00010000:00000040:5.0:1550079902.041421:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265613
00010000:00000040:20.0:1550079902.041422:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22435
00010000:00000040:5.0:1550079902.041422:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265612
00010000:00000040:5.0:1550079902.041423:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265620
00000020:00000040:5.0:1550079902.041423:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265622
00010000:00010000:20.0:1550079902.041424:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9de960c0/0x6bcd99f6a7d92aad lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22435 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bfdfbd expref: 22435 pid: 21809 timeout: 0 lvb_type: 0
00000001:00000040:5.0:1550079902.041425:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 13
00010000:00000040:20.0:1550079902.041427:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22434
00010000:00000040:20.0:1550079902.041428:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22433
00010000:00000040:20.0:1550079902.041428:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22433
00000020:00000040:20.0:1550079902.041429:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22434
00000001:00000040:20.0:1550079902.041431:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 9
00010000:00000040:5.0:1550079902.042179:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265613
00000004:00000040:5.0:1550079902.042180:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.042181:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265614
00010000:00010000:5.0:1550079902.042183:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd458bc0480/0x6bcd99f6a870b976 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265614 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff32460d expref: 265622 pid: 21820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.042186:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265613
00000020:00000040:5.0:1550079902.042188:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd458bc0480 with handle 0x6bcd99f6a870b976 from hash
00010000:00000040:5.0:1550079902.042189:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265612
00010000:00000040:5.0:1550079902.042190:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265613
00010000:00010000:5.0:1550079902.042191:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd458bc0480/0x6bcd99f6a870b976 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265613 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff32460d expref: 265622 pid: 21820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.042194:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265612
00010000:00000040:5.0:1550079902.042195:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265611
00010000:00000040:5.0:1550079902.042195:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265619
00000020:00000040:5.0:1550079902.042196:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265621
00000001:00000040:5.0:1550079902.042197:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 14
00010000:00000040:20.0:1550079902.042395:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22434
00000004:00000040:20.0:1550079902.042396:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.042397:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e1b3e1d40 with handle 0x6bcd99f6a7a3070f from hash
00010000:00000040:20.0:1550079902.042398:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22433
00010000:00000040:20.0:1550079902.042399:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22434
00010000:00010000:20.0:1550079902.042401:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e1b3e1d40/0x6bcd99f6a7a3070f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22434 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b8dfbd expref: 22434 pid: 21773 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.042404:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22433
00010000:00000040:20.0:1550079902.042405:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22432
00010000:00000040:20.0:1550079902.042405:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22432
00000020:00000040:20.0:1550079902.042406:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22433
00000001:00000040:20.0:1550079902.042407:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 10
00010000:00000040:5.0:1550079902.042951:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265612
00000004:00000040:5.0:1550079902.042951:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.042952:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265613
00010000:00010000:5.0:1550079902.042954:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc46b891f80/0x6bcd99f6a859ee5c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265613 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2b460d expref: 265621 pid: 21448 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.042958:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265612
00000020:00000040:5.0:1550079902.042959:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46b891f80 with handle 0x6bcd99f6a859ee5c from hash
00010000:00000040:5.0:1550079902.042960:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265611
00010000:00000040:5.0:1550079902.042961:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265612
00010000:00010000:5.0:1550079902.042962:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46b891f80/0x6bcd99f6a859ee5c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265612 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2b460d expref: 265621 pid: 21448 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.042965:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265611
00010000:00000040:5.0:1550079902.042966:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265610
00010000:00000040:5.0:1550079902.042967:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265618
00000020:00000040:5.0:1550079902.042967:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265620
00000001:00000040:5.0:1550079902.042968:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 15
00010000:00000040:20.0:1550079902.043372:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22433
00000004:00000040:20.0:1550079902.043374:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.043375:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d96961440 with handle 0x6bcd99f6a76d498b from hash
00010000:00000040:20.0:1550079902.043376:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22432
00010000:00000040:20.0:1550079902.043377:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22433
00010000:00010000:20.0:1550079902.043379:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d96961440/0x6bcd99f6a76d498b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22433 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b1dfbd expref: 22433 pid: 21833 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.043382:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22432
00010000:00000040:20.0:1550079902.043383:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22431
00010000:00000040:20.0:1550079902.043383:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22431
00000020:00000040:20.0:1550079902.043384:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22432
00000001:00000040:20.0:1550079902.043385:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 11
00010000:00000040:5.0:1550079902.043720:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265611
00000004:00000040:5.0:1550079902.043721:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.043722:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265612
00010000:00010000:5.0:1550079902.043723:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc43affd7c0/0x6bcd99f6a84333aa lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265612 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff24460d expref: 265620 pid: 21859 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.043727:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265611
00000020:00000040:5.0:1550079902.043728:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc43affd7c0 with handle 0x6bcd99f6a84333aa from hash
00010000:00000040:5.0:1550079902.043729:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265610
00010000:00000040:5.0:1550079902.043730:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265611
00010000:00010000:5.0:1550079902.043731:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc43affd7c0/0x6bcd99f6a84333aa lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265611 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff24460d expref: 265620 pid: 21859 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.043734:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265610
00010000:00000040:5.0:1550079902.043735:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265609
00010000:00000040:5.0:1550079902.043736:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265617
00000020:00000040:5.0:1550079902.043737:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265619
00000001:00000040:5.0:1550079902.043738:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 16
00010000:00000040:20.0:1550079902.044348:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22432
00000004:00000040:20.0:1550079902.044349:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.044351:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc35a328000 with handle 0x6bcd99f6a747bc1c from hash
00010000:00000040:20.0:1550079902.044352:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22431
00010000:00000040:20.0:1550079902.044353:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22432
00010000:00010000:20.0:1550079902.044354:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc35a328000/0x6bcd99f6a747bc1c lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22432 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52aadfbd expref: 22432 pid: 21581 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.044358:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22431
00010000:00000040:20.0:1550079902.044358:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22430
00010000:00000040:20.0:1550079902.044359:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22430
00000020:00000040:20.0:1550079902.044360:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22431
00000001:00000040:20.0:1550079902.044361:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 12
00010000:00000040:5.0:1550079902.044510:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265610
00000004:00000040:5.0:1550079902.044511:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.044512:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265611
00010000:00010000:5.0:1550079902.044514:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd48fb54140/0x6bcd99f6a8321f74 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265611 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1d460d expref: 265619 pid: 21711 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.044517:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265610
00000020:00000040:5.0:1550079902.044518:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48fb54140 with handle 0x6bcd99f6a8321f74 from hash
00010000:00000040:5.0:1550079902.044519:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265609
00010000:00000040:5.0:1550079902.044520:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265610
00010000:00010000:5.0:1550079902.044521:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48fb54140/0x6bcd99f6a8321f74 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265610 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1d460d expref: 265619 pid: 21711 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.044524:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265609
00010000:00000040:5.0:1550079902.044525:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265608
00010000:00000040:5.0:1550079902.044526:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265616
00000020:00000040:5.0:1550079902.044527:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265618
00000001:00000040:5.0:1550079902.044528:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 17
00010000:00000040:5.0:1550079902.045284:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265609
00000004:00000040:5.0:1550079902.045285:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.045285:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265610
00010000:00010000:5.0:1550079902.045287:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c2182640/0x6bcd99f6a821069f lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265610 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff16460d expref: 265618 pid: 20774 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.045290:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265609
00000020:00000040:5.0:1550079902.045292:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3c2182640 with handle 0x6bcd99f6a821069f from hash
00010000:00000040:5.0:1550079902.045293:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265608
00010000:00000040:5.0:1550079902.045293:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265609
00010000:00010000:5.0:1550079902.045295:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c2182640/0x6bcd99f6a821069f lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265609 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff16460d expref: 265618 pid: 20774 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.045298:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265608
00010000:00000040:5.0:1550079902.045299:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265607
00010000:00000040:5.0:1550079902.045299:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265615
00000020:00000040:5.0:1550079902.045300:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265617
00000001:00000040:5.0:1550079902.045301:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 18
00010000:00000040:20.0:1550079902.045326:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22431
00000004:00000040:20.0:1550079902.045326:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.045328:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3d3a29b00 with handle 0x6bcd99f6a7102d49 from hash
00010000:00000040:20.0:1550079902.045329:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22430
00010000:00000040:20.0:1550079902.045330:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22431
00010000:00010000:20.0:1550079902.045332:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3d3a29b00/0x6bcd99f6a7102d49 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22431 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a3dfbd expref: 22431 pid: 20528 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.045335:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22430
00010000:00000040:20.0:1550079902.045336:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22429
00010000:00000040:20.0:1550079902.045337:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22429
00000020:00000040:20.0:1550079902.045338:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22430
00000001:00000040:20.0:1550079902.045339:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 13
00010000:00000040:5.0:1550079902.046053:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265608
00000004:00000040:5.0:1550079902.046053:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.046054:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265609
00010000:00010000:5.0:1550079902.046056:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4584c9f80/0x6bcd99f6a8099b65 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265609 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0f460d expref: 265617 pid: 21721 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.046059:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265608
00000020:00000040:5.0:1550079902.046060:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4584c9f80 with handle 0x6bcd99f6a8099b65 from hash
00010000:00000040:5.0:1550079902.046061:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265607
00010000:00000040:5.0:1550079902.046062:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265608
00010000:00010000:5.0:1550079902.046064:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4584c9f80/0x6bcd99f6a8099b65 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265608 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0f460d expref: 265617 pid: 21721 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.046067:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265607
00010000:00000040:5.0:1550079902.046067:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265606
00010000:00000040:5.0:1550079902.046068:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265614
00000020:00000040:5.0:1550079902.046069:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265616
00000001:00000040:5.0:1550079902.046070:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 19
00010000:00000040:20.0:1550079902.046304:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22430
00000004:00000040:20.0:1550079902.046305:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.046307:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd468444380 with handle 0x6bcd99f6a95c1de4 from hash
00010000:00000040:20.0:1550079902.046308:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22429
00010000:00000040:20.0:1550079902.046309:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22430
00010000:00010000:20.0:1550079902.046311:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd468444380/0x6bcd99f6a95c1de4 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22430 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e7e7bd expref: 22430 pid: 21133 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.046314:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22429
00010000:00000040:20.0:1550079902.046314:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22428
00010000:00000040:20.0:1550079902.046315:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22428
00000020:00000040:20.0:1550079902.046316:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22429
00000001:00000040:20.0:1550079902.046317:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 14
00010000:00000040:5.0:1550079902.046822:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265607
00000004:00000040:5.0:1550079902.046822:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.046824:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265608
00010000:00010000:5.0:1550079902.046825:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd486ea06c0/0x6bcd99f6a7ecc0eb lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265608 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff08460d expref: 265616 pid: 21067 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.046829:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265607
00000020:00000040:5.0:1550079902.046831:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd486ea06c0 with handle 0x6bcd99f6a7ecc0eb from hash
00010000:00000040:5.0:1550079902.046832:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265606
00010000:00000040:5.0:1550079902.046833:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265607
00010000:00010000:5.0:1550079902.046834:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd486ea06c0/0x6bcd99f6a7ecc0eb lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265607 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff08460d expref: 265616 pid: 21067 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.046837:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265606
00010000:00000040:5.0:1550079902.046838:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265605
00010000:00000040:5.0:1550079902.046838:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265613
00000020:00000040:5.0:1550079902.046839:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265615
00000001:00000040:5.0:1550079902.046840:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 20
00010000:00000040:20.0:1550079902.047282:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22429
00000004:00000040:20.0:1550079902.047283:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.047284:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc404c40b40 with handle 0x6bcd99f6a90cc596 from hash
00010000:00000040:20.0:1550079902.047286:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22428
00010000:00000040:20.0:1550079902.047287:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22429
00010000:00010000:20.0:1550079902.047288:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc404c40b40/0x6bcd99f6a90cc596 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22429 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e0e7bd expref: 22429 pid: 21820 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.047291:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22428
00010000:00000040:20.0:1550079902.047293:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22427
00010000:00000040:20.0:1550079902.047293:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22427
00000020:00000040:20.0:1550079902.047294:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22428
00000001:00000040:20.0:1550079902.047296:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 15
00010000:00000040:5.0:1550079902.047597:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265606
00000004:00000040:5.0:1550079902.047597:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.047598:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265607
00010000:00010000:5.0:1550079902.047600:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4a68c8000/0x6bcd99f6a7bf588b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265607 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff01460d expref: 265615 pid: 21739 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.047603:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265606
00000020:00000040:5.0:1550079902.047604:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4a68c8000 with handle 0x6bcd99f6a7bf588b from hash
00010000:00000040:5.0:1550079902.047605:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265605
00010000:00000040:5.0:1550079902.047606:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265606
00010000:00010000:5.0:1550079902.047608:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4a68c8000/0x6bcd99f6a7bf588b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265606 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff01460d expref: 265615 pid: 21739 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.047611:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265605
00010000:00000040:5.0:1550079902.047611:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265604
00010000:00000040:5.0:1550079902.047612:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265612
00000020:00000040:5.0:1550079902.047613:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265614
00000001:00000040:5.0:1550079902.047615:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 21
00010000:00000040:20.0:1550079902.048261:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22428
00000004:00000040:20.0:1550079902.048262:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.048263:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb42d2c7500 with handle 0x6bcd99f6a8d569d0 from hash
00010000:00000040:20.0:1550079902.048264:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22427
00010000:00000040:20.0:1550079902.048265:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22428
00010000:00010000:20.0:1550079902.048267:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb42d2c7500/0x6bcd99f6a8d569d0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22428 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d9e7bd expref: 22428 pid: 21329 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.048270:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22427
00010000:00000040:20.0:1550079902.048271:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22426
00010000:00000040:20.0:1550079902.048271:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22426
00000020:00000040:20.0:1550079902.048272:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22427
00000001:00000040:20.0:1550079902.048273:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 16
00010000:00000040:5.0:1550079902.048371:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265605
00000004:00000040:5.0:1550079902.048372:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.048372:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265606
00010000:00010000:5.0:1550079902.048374:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4f024d7c0/0x6bcd99f6a78f2aed lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265606 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefa460d expref: 265614 pid: 21456 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.048378:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265605
00000020:00000040:5.0:1550079902.048379:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4f024d7c0 with handle 0x6bcd99f6a78f2aed from hash
00010000:00000040:5.0:1550079902.048380:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265604
00010000:00000040:5.0:1550079902.048381:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265605
00010000:00010000:5.0:1550079902.048382:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4f024d7c0/0x6bcd99f6a78f2aed lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265605 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefa460d expref: 265614 pid: 21456 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.048385:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265604
00010000:00000040:5.0:1550079902.048386:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265603
00010000:00000040:5.0:1550079902.048386:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265611
00000020:00000040:5.0:1550079902.048387:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265613
00000001:00000040:5.0:1550079902.048388:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 22
00010000:00000040:5.0:1550079902.049144:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265604
00000004:00000040:5.0:1550079902.049145:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.049146:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265605
00010000:00010000:5.0:1550079902.049147:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd45466b180/0x6bcd99f6a766f8d1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265605 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef3460d expref: 265613 pid: 21794 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.049150:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265604
00000020:00000040:5.0:1550079902.049151:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45466b180 with handle 0x6bcd99f6a766f8d1 from hash
00010000:00000040:5.0:1550079902.049152:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265603
00010000:00000040:5.0:1550079902.049153:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265604
00010000:00010000:5.0:1550079902.049154:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45466b180/0x6bcd99f6a766f8d1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265604 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef3460d expref: 265613 pid: 21794 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.049158:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265603
00010000:00000040:5.0:1550079902.049158:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265602
00010000:00000040:5.0:1550079902.049159:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265610
00000020:00000040:5.0:1550079902.049159:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265612
00000001:00000040:5.0:1550079902.049160:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 23
00010000:00000040:20.0:1550079902.049237:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22427
00000004:00000040:20.0:1550079902.049238:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.049239:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f6c3a1b00 with handle 0x6bcd99f6a8940d76 from hash
00010000:00000040:20.0:1550079902.049240:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22426
00010000:00000040:20.0:1550079902.049241:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22427
00010000:00010000:20.0:1550079902.049243:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f6c3a1b00/0x6bcd99f6a8940d76 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22427 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d2e7bd expref: 22427 pid: 21575 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.049246:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22426
00010000:00000040:20.0:1550079902.049247:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22425
00010000:00000040:20.0:1550079902.049248:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22425
00000020:00000040:20.0:1550079902.049248:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22426
00000001:00000040:20.0:1550079902.049249:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 17
00010000:00000040:5.0:1550079902.049913:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265603
00000004:00000040:5.0:1550079902.049914:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.049914:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265604
00010000:00010000:5.0:1550079902.049916:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd458099440/0x6bcd99f6a7448499 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265604 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feec460d expref: 265612 pid: 20532 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.049919:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265603
00000020:00000040:5.0:1550079902.049921:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd458099440 with handle 0x6bcd99f6a7448499 from hash
00010000:00000040:5.0:1550079902.049922:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265602
00010000:00000040:5.0:1550079902.049923:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265603
00010000:00010000:5.0:1550079902.049924:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd458099440/0x6bcd99f6a7448499 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265603 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feec460d expref: 265612 pid: 20532 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.049927:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265602
00010000:00000040:5.0:1550079902.049928:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265601
00010000:00000040:5.0:1550079902.049929:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265609
00000020:00000040:5.0:1550079902.049929:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265611
00000001:00000040:5.0:1550079902.049931:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 24
00010000:00000040:20.0:1550079902.050215:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22426
00000004:00000040:20.0:1550079902.050216:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.050217:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca456224c80 with handle 0x6bcd99f6a84ba418 from hash
00010000:00000040:20.0:1550079902.050219:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22425
00010000:00000040:20.0:1550079902.050220:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22426
00010000:00010000:20.0:1550079902.050221:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca456224c80/0x6bcd99f6a84ba418 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22426 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cbe7bd expref: 22426 pid: 21336 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.050224:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22425
00010000:00000040:20.0:1550079902.050225:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22424
00010000:00000040:20.0:1550079902.050226:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22424
00000020:00000040:20.0:1550079902.050227:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22425
00000001:00000040:20.0:1550079902.050228:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 18
00010000:00000040:5.0:1550079902.050683:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265602
00000004:00000040:5.0:1550079902.050684:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.050684:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265603
00010000:00010000:5.0:1550079902.050686:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d540c2ac0/0x6bcd99f6a718dc32 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265603 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee5460d expref: 265611 pid: 20793 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.050690:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265602
00000020:00000040:5.0:1550079902.050691:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d540c2ac0 with handle 0x6bcd99f6a718dc32 from hash
00010000:00000040:5.0:1550079902.050692:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265601
00010000:00000040:5.0:1550079902.050693:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265602
00010000:00010000:5.0:1550079902.050694:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d540c2ac0/0x6bcd99f6a718dc32 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265602 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee5460d expref: 265611 pid: 20793 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.050697:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265601
00010000:00000040:5.0:1550079902.050698:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265600
00010000:00000040:5.0:1550079902.050699:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265608
00000020:00000040:5.0:1550079902.050700:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265610
00000001:00000040:5.0:1550079902.050701:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 25
00010000:00000040:20.0:1550079902.051193:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22425
00000004:00000040:20.0:1550079902.051194:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.051195:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9db71145c0 with handle 0x6bcd99f6a81429c0 from hash
00010000:00000040:20.0:1550079902.051197:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22424
00010000:00000040:20.0:1550079902.051197:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22425
00010000:00010000:20.0:1550079902.051199:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9db71145c0/0x6bcd99f6a81429c0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22425 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c4e7bd expref: 22425 pid: 21809 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.051202:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22424
00010000:00000040:20.0:1550079902.051203:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22423
00010000:00000040:20.0:1550079902.051204:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22423
00000020:00000040:20.0:1550079902.051205:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22424
00000001:00000040:20.0:1550079902.051206:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 19
00010000:00000040:5.0:1550079902.051457:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265601
00000004:00000040:5.0:1550079902.051458:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.051459:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265602
00010000:00010000:5.0:1550079902.051460:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f1a2f980/0x6bcd99f6a6f86587 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265602 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fede460d expref: 265610 pid: 21843 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.051464:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265601
00000020:00000040:5.0:1550079902.051465:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f1a2f980 with handle 0x6bcd99f6a6f86587 from hash
00010000:00000040:5.0:1550079902.051466:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265600
00010000:00000040:5.0:1550079902.051467:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265601
00010000:00010000:5.0:1550079902.051468:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f1a2f980/0x6bcd99f6a6f86587 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265601 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fede460d expref: 265610 pid: 21843 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.051471:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265600
00010000:00000040:5.0:1550079902.051472:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265599
00010000:00000040:5.0:1550079902.051473:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265607
00000020:00000040:5.0:1550079902.051474:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265609
00000001:00000040:5.0:1550079902.051475:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 26
00010000:00000040:20.0:1550079902.052170:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22424
00000004:00000040:20.0:1550079902.052171:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.052172:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3c20a60c0 with handle 0x6bcd99f6a7c3c74f from hash
00010000:00000040:20.0:1550079902.052173:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22423
00010000:00000040:20.0:1550079902.052175:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22424
00010000:00010000:20.0:1550079902.052176:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c20a60c0/0x6bcd99f6a7c3c74f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22424 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bde7bd expref: 22424 pid: 21745 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.052180:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22423
00010000:00000040:20.0:1550079902.052180:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22422
00010000:00000040:20.0:1550079902.052181:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22422
00000020:00000040:20.0:1550079902.052182:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22423
00000001:00000040:20.0:1550079902.052183:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 20
00010000:00000040:5.0:1550079902.052232:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265600
00000004:00000040:5.0:1550079902.052233:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.052233:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265601
00010000:00010000:5.0:1550079902.052235:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb40a63e540/0x6bcd99f6a6cb05e7 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265601 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed7460d expref: 265609 pid: 21248 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.052238:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265600
00000020:00000040:5.0:1550079902.052240:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb40a63e540 with handle 0x6bcd99f6a6cb05e7 from hash
00010000:00000040:5.0:1550079902.052241:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265599
00010000:00000040:5.0:1550079902.052242:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265600
00010000:00010000:5.0:1550079902.052243:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb40a63e540/0x6bcd99f6a6cb05e7 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265600 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed7460d expref: 265609 pid: 21248 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.052246:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265599
00010000:00000040:5.0:1550079902.052247:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265598
00010000:00000040:5.0:1550079902.052247:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265606
00000020:00000040:5.0:1550079902.052248:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265608
00000001:00000040:5.0:1550079902.052249:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 27
00010000:00000040:5.0:1550079902.053005:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265599
00000004:00000040:5.0:1550079902.053006:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.053007:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265600
00010000:00010000:5.0:1550079902.053008:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4b06caac0/0x6bcd99f6a6a920d4 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265600 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed0460d expref: 265608 pid: 21725 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.053012:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265599
00000020:00000040:5.0:1550079902.053013:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4b06caac0 with handle 0x6bcd99f6a6a920d4 from hash
00010000:00000040:5.0:1550079902.053014:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265598
00010000:00000040:5.0:1550079902.053014:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265599
00010000:00010000:5.0:1550079902.053016:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4b06caac0/0x6bcd99f6a6a920d4 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265599 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed0460d expref: 265608 pid: 21725 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.053019:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265598
00010000:00000040:5.0:1550079902.053020:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265597
00010000:00000040:5.0:1550079902.053020:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265605
00000020:00000040:5.0:1550079902.053021:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265607
00000001:00000040:5.0:1550079902.053022:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 28
00010000:00000040:20.0:1550079902.053148:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22423
00000004:00000040:20.0:1550079902.053149:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.053150:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3b3323600 with handle 0x6bcd99f6a7990317 from hash
00010000:00000040:20.0:1550079902.053151:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22422
00010000:00000040:20.0:1550079902.053152:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22423
00010000:00010000:20.0:1550079902.053154:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3b3323600/0x6bcd99f6a7990317 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22423 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b6e7bd expref: 22423 pid: 20612 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.053157:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22422
00010000:00000040:20.0:1550079902.053158:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22421
00010000:00000040:20.0:1550079902.053159:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22421
00000020:00000040:20.0:1550079902.053159:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22422
00000001:00000040:20.0:1550079902.053161:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 21
00010000:00000040:5.0:1550079902.053770:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265598
00000004:00000040:5.0:1550079902.053771:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.053772:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265599
00010000:00010000:5.0:1550079902.053773:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9eb2475580/0x6bcd99f6a8a02c9f lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265599 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3e4e0d expref: 265607 pid: 21811 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.053776:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265598
00000020:00000040:5.0:1550079902.053778:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9eb2475580 with handle 0x6bcd99f6a8a02c9f from hash
00010000:00000040:5.0:1550079902.053779:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265597
00010000:00000040:5.0:1550079902.053780:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265598
00010000:00010000:5.0:1550079902.053781:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9eb2475580/0x6bcd99f6a8a02c9f lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265598 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3e4e0d expref: 265607 pid: 21811 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.053784:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265597
00010000:00000040:5.0:1550079902.053785:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265596
00010000:00000040:5.0:1550079902.053786:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265604
00000020:00000040:5.0:1550079902.053786:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265606
00000001:00000040:5.0:1550079902.053787:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 29
00010000:00000040:20.0:1550079902.054125:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22422
00000004:00000040:20.0:1550079902.054126:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.054128:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd407261680 with handle 0x6bcd99f6a75e5468 from hash
00010000:00000040:20.0:1550079902.054129:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22421
00010000:00000040:20.0:1550079902.054130:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22422
00010000:00010000:20.0:1550079902.054131:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd407261680/0x6bcd99f6a75e5468 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22422 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52afe7bd expref: 22422 pid: 21895 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.054138:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22421
00010000:00000040:20.0:1550079902.054139:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22420
00010000:00000040:20.0:1550079902.054139:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22420
00000020:00000040:20.0:1550079902.054140:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22421
00000001:00000040:20.0:1550079902.054141:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 22
00010000:00000040:5.0:1550079902.054544:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265597
00000004:00000040:5.0:1550079902.054545:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.054545:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265598
00010000:00010000:5.0:1550079902.054547:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca34676d580/0x6bcd99f6a8819ee3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265598 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff374e0d expref: 265606 pid: 21346 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.054551:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265597
00000020:00000040:5.0:1550079902.054553:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca34676d580 with handle 0x6bcd99f6a8819ee3 from hash
00010000:00000040:5.0:1550079902.054554:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265596
00010000:00000040:5.0:1550079902.054554:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265597
00010000:00010000:5.0:1550079902.054556:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca34676d580/0x6bcd99f6a8819ee3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265597 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff374e0d expref: 265606 pid: 21346 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.054559:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265596
00010000:00000040:5.0:1550079902.054559:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265595
00010000:00000040:5.0:1550079902.054560:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265603
00000020:00000040:5.0:1550079902.054561:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265605
00000001:00000040:5.0:1550079902.054562:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 30
00010000:00000040:20.0:1550079902.055106:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22421
00000004:00000040:20.0:1550079902.055107:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.055108:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4761ff740 with handle 0x6bcd99f6a737ae0b from hash
00010000:00000040:20.0:1550079902.055110:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22420
00010000:00000040:20.0:1550079902.055111:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22421
00010000:00010000:20.0:1550079902.055112:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4761ff740/0x6bcd99f6a737ae0b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22421 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a8e7bd expref: 22421 pid: 21721 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.055115:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22420
00010000:00000040:20.0:1550079902.055116:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22419
00010000:00000040:20.0:1550079902.055117:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22419
00000020:00000040:20.0:1550079902.055118:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22420
00000001:00000040:20.0:1550079902.055119:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 23
00010000:00000040:5.0:1550079902.055318:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265596
00000004:00000040:5.0:1550079902.055319:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.055320:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265597
00010000:00010000:5.0:1550079902.055322:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd3a6f29d40/0x6bcd99f6a867ca52 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265597 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff304e0d expref: 265605 pid: 21797 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.055325:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265596
00000020:00000040:5.0:1550079902.055327:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3a6f29d40 with handle 0x6bcd99f6a867ca52 from hash
00010000:00000040:5.0:1550079902.055328:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265595
00010000:00000040:5.0:1550079902.055329:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265596
00010000:00010000:5.0:1550079902.055330:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3a6f29d40/0x6bcd99f6a867ca52 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265596 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff304e0d expref: 265605 pid: 21797 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.055333:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265595
00010000:00000040:5.0:1550079902.055334:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265594
00010000:00000040:5.0:1550079902.055335:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265602
00000020:00000040:5.0:1550079902.055336:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265604
00000001:00000040:5.0:1550079902.055337:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 31
00010000:00000040:20.0:1550079902.056083:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22420
00000004:00000040:20.0:1550079902.056084:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.056085:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb43552ad00 with handle 0x6bcd99f6a705a642 from hash
00010000:00000040:20.0:1550079902.056086:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22419
00010000:00000040:20.0:1550079902.056087:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22420
00010000:00010000:20.0:1550079902.056089:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb43552ad00/0x6bcd99f6a705a642 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22420 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a1e7bd expref: 22420 pid: 20822 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.056092:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22419
00010000:00000040:20.0:1550079902.056092:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22418
00010000:00000040:5.0:1550079902.056093:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265595
00010000:00000040:20.0:1550079902.056094:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22418
00000004:00000040:5.0:1550079902.056094:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00000020:00000040:20.0:1550079902.056095:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22419
00010000:00000040:5.0:1550079902.056095:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265596
00000001:00000040:20.0:1550079902.056096:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 24
00010000:00010000:5.0:1550079902.056096:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc46da54140/0x6bcd99f6a8520eda lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265596 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff294e0d expref: 265604 pid: 21271 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.056100:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265595
00000020:00000040:5.0:1550079902.056101:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46da54140 with handle 0x6bcd99f6a8520eda from hash
00010000:00000040:5.0:1550079902.056102:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265594
00010000:00000040:5.0:1550079902.056103:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265595
00010000:00010000:5.0:1550079902.056104:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46da54140/0x6bcd99f6a8520eda lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265595 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff294e0d expref: 265604 pid: 21271 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.056107:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265594
00010000:00000040:5.0:1550079902.056108:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265593
00010000:00000040:5.0:1550079902.056109:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265601
00000020:00000040:5.0:1550079902.056110:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265603
00000001:00000040:5.0:1550079902.056111:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 32
00010000:00000040:5.0:1550079902.056866:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265594
00000004:00000040:5.0:1550079902.056867:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.056868:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265595
00010000:00010000:5.0:1550079902.056869:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc403cb45c0/0x6bcd99f6a83f9c50 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265595 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff224e0d expref: 265603 pid: 21450 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.056873:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265594
00000020:00000040:5.0:1550079902.056874:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc403cb45c0 with handle 0x6bcd99f6a83f9c50 from hash
00010000:00000040:5.0:1550079902.056875:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265593
00010000:00000040:5.0:1550079902.056876:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265594
00010000:00010000:5.0:1550079902.056877:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc403cb45c0/0x6bcd99f6a83f9c50 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265594 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff224e0d expref: 265603 pid: 21450 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.056881:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265593
00010000:00000040:5.0:1550079902.056881:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265592
00010000:00000040:5.0:1550079902.056882:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265600
00000020:00000040:5.0:1550079902.056882:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265602
00000001:00000040:5.0:1550079902.056883:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 33
00010000:00000040:20.0:1550079902.057061:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22419
00000004:00000040:20.0:1550079902.057062:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.057063:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb480e12d00 with handle 0x6bcd99f6a93f1e48 from hash
00010000:00000040:20.0:1550079902.057064:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22418
00010000:00000040:20.0:1550079902.057065:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22419
00010000:00010000:20.0:1550079902.057067:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb480e12d00/0x6bcd99f6a93f1e48 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22419 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e5efbd expref: 22419 pid: 21813 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.057070:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22418
00010000:00000040:20.0:1550079902.057070:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22417
00010000:00000040:20.0:1550079902.057071:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22417
00000020:00000040:20.0:1550079902.057072:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22418
00000001:00000040:20.0:1550079902.057073:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 25
00010000:00000040:5.0:1550079902.057631:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265593
00000004:00000040:5.0:1550079902.057632:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.057633:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265594
00010000:00010000:5.0:1550079902.057634:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3fdd5e9c0/0x6bcd99f6a82cd6e5 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265594 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1b4e0d expref: 265602 pid: 20528 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.057637:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265593
00000020:00000040:5.0:1550079902.057639:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3fdd5e9c0 with handle 0x6bcd99f6a82cd6e5 from hash
00010000:00000040:5.0:1550079902.057640:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265592
00010000:00000040:5.0:1550079902.057641:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265593
00010000:00010000:5.0:1550079902.057642:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3fdd5e9c0/0x6bcd99f6a82cd6e5 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265593 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1b4e0d expref: 265602 pid: 20528 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.057645:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265592
00010000:00000040:5.0:1550079902.057646:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265591
00010000:00000040:5.0:1550079902.057647:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265599
00000020:00000040:5.0:1550079902.057648:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265601
00000001:00000040:5.0:1550079902.057649:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 34
00010000:00000040:20.0:1550079902.058038:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22418
00000004:00000040:20.0:1550079902.058039:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.058040:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd47cb96780 with handle 0x6bcd99f6a903847f from hash
00010000:00000040:20.0:1550079902.058041:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22417
00010000:00000040:20.0:1550079902.058042:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22418
00010000:00010000:20.0:1550079902.058044:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd47cb96780/0x6bcd99f6a903847f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22418 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52deefbd expref: 22418 pid: 20534 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.058047:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22417
00010000:00000040:20.0:1550079902.058048:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22416
00010000:00000040:20.0:1550079902.058048:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22416
00000020:00000040:20.0:1550079902.058049:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22417
00000001:00000040:20.0:1550079902.058050:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 26
00010000:00000040:5.0:1550079902.058405:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265592
00000004:00000040:5.0:1550079902.058406:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.058406:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265593
00010000:00010000:5.0:1550079902.058408:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3cc1998c0/0x6bcd99f6a8193c9b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265593 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff144e0d expref: 265601 pid: 21736 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.058412:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265592
00000020:00000040:5.0:1550079902.058413:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3cc1998c0 with handle 0x6bcd99f6a8193c9b from hash
00010000:00000040:5.0:1550079902.058414:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265591
00010000:00000040:5.0:1550079902.058415:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265592
00010000:00010000:5.0:1550079902.058416:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3cc1998c0/0x6bcd99f6a8193c9b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265592 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff144e0d expref: 265601 pid: 21736 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.058419:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265591
00010000:00000040:5.0:1550079902.058420:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265590
00010000:00000040:5.0:1550079902.058421:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265598
00000020:00000040:5.0:1550079902.058422:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265600
00000001:00000040:5.0:1550079902.058423:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 35
00010000:00000040:20.0:1550079902.059014:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22417
00000004:00000040:20.0:1550079902.059016:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.059018:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9ee63eba80 with handle 0x6bcd99f6a8bda422 from hash
00010000:00000040:20.0:1550079902.059019:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22416
00010000:00000040:20.0:1550079902.059020:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22417
00010000:00010000:20.0:1550079902.059022:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9ee63eba80/0x6bcd99f6a8bda422 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22417 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d7efbd expref: 22417 pid: 21343 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.059025:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22416
00010000:00000040:20.0:1550079902.059025:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22415
00010000:00000040:20.0:1550079902.059026:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22415
00000020:00000040:20.0:1550079902.059027:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22416
00000001:00000040:20.0:1550079902.059028:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 27
00010000:00000040:5.0:1550079902.059178:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265591
00000004:00000040:5.0:1550079902.059179:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.059180:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265592
00010000:00010000:5.0:1550079902.059181:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4aebd6c00/0x6bcd99f6a803969a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265592 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0d4e0d expref: 265600 pid: 21725 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.059185:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265591
00000020:00000040:5.0:1550079902.059186:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4aebd6c00 with handle 0x6bcd99f6a803969a from hash
00010000:00000040:5.0:1550079902.059187:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265590
00010000:00000040:5.0:1550079902.059188:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265591
00010000:00010000:5.0:1550079902.059189:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4aebd6c00/0x6bcd99f6a803969a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265591 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0d4e0d expref: 265600 pid: 21725 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.059192:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265590
00010000:00000040:5.0:1550079902.059193:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265589
00010000:00000040:5.0:1550079902.059194:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265597
00000020:00000040:5.0:1550079902.059195:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265599
00000001:00000040:5.0:1550079902.059196:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 36
00010000:00000040:5.0:1550079902.059952:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265590
00000004:00000040:5.0:1550079902.059953:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.059954:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265591
00010000:00010000:5.0:1550079902.059955:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9febb969c0/0x6bcd99f6a7e119da lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265591 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff064e0d expref: 265599 pid: 21431 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.059958:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265590
00000020:00000040:5.0:1550079902.059959:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9febb969c0 with handle 0x6bcd99f6a7e119da from hash
00010000:00000040:5.0:1550079902.059960:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265589
00010000:00000040:5.0:1550079902.059961:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265590
00010000:00010000:5.0:1550079902.059962:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9febb969c0/0x6bcd99f6a7e119da lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265590 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff064e0d expref: 265599 pid: 21431 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.059965:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265589
00010000:00000040:5.0:1550079902.059966:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265588
00010000:00000040:5.0:1550079902.059966:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265596
00000020:00000040:5.0:1550079902.059967:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265598
00000001:00000040:5.0:1550079902.059968:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 37
00010000:00000040:20.0:1550079902.059992:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22416
00000004:00000040:20.0:1550079902.059993:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.059994:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3ee5ff080 with handle 0x6bcd99f6a8863ec3 from hash
00010000:00000040:20.0:1550079902.059996:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22415
00010000:00000040:20.0:1550079902.059996:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22416
00010000:00010000:20.0:1550079902.059998:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3ee5ff080/0x6bcd99f6a8863ec3 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22416 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d0efbd expref: 22416 pid: 21644 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.060001:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22415
00010000:00000040:20.0:1550079902.060002:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22414
00010000:00000040:20.0:1550079902.060002:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22414
00000020:00000040:20.0:1550079902.060003:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22415
00000001:00000040:20.0:1550079902.060004:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 28
00010000:00000040:5.0:1550079902.060715:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265589
00000004:00000040:5.0:1550079902.060716:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.060717:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265590
00010000:00010000:5.0:1550079902.060719:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca36a6eb840/0x6bcd99f6a7aeba60 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265590 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feff4e0d expref: 265598 pid: 20526 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.060722:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265589
00000020:00000040:5.0:1550079902.060724:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca36a6eb840 with handle 0x6bcd99f6a7aeba60 from hash
00010000:00000040:5.0:1550079902.060725:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265588
00010000:00000040:5.0:1550079902.060726:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265589
00010000:00010000:5.0:1550079902.060728:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca36a6eb840/0x6bcd99f6a7aeba60 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265589 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feff4e0d expref: 265598 pid: 20526 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.060731:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265588
00010000:00000040:5.0:1550079902.060731:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265587
00010000:00000040:5.0:1550079902.060732:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265595
00000020:00000040:5.0:1550079902.060733:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265597
00000001:00000040:5.0:1550079902.060734:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 38
00010000:00000040:20.0:1550079902.060969:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22415
00000004:00000040:20.0:1550079902.060970:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.060971:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f44a6780 with handle 0x6bcd99f6a8387528 from hash
00010000:00000040:20.0:1550079902.060972:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22414
00010000:00000040:20.0:1550079902.060973:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22415
00010000:00010000:20.0:1550079902.060975:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f44a6780/0x6bcd99f6a8387528 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22415 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c9efbd expref: 22415 pid: 21855 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.060978:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22414
00010000:00000040:20.0:1550079902.060979:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22413
00010000:00000040:20.0:1550079902.060980:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22413
00000020:00000040:20.0:1550079902.060981:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22414
00000001:00000040:20.0:1550079902.060982:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 29
00010000:00000040:5.0:1550079902.061490:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265588
00000004:00000040:5.0:1550079902.061491:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.061492:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265589
00010000:00010000:5.0:1550079902.061493:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd496bf1f80/0x6bcd99f6a7875c43 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265589 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef84e0d expref: 265597 pid: 21773 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.061497:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265588
00000020:00000040:5.0:1550079902.061498:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd496bf1f80 with handle 0x6bcd99f6a7875c43 from hash
00010000:00000040:5.0:1550079902.061499:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265587
00010000:00000040:5.0:1550079902.061500:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265588
00010000:00010000:5.0:1550079902.061501:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd496bf1f80/0x6bcd99f6a7875c43 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265588 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef84e0d expref: 265597 pid: 21773 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.061504:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265587
00010000:00000040:5.0:1550079902.061505:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265586
00010000:00000040:5.0:1550079902.061506:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265594
00000020:00000040:5.0:1550079902.061507:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265596
00000001:00000040:5.0:1550079902.061508:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 39
00010000:00000040:20.0:1550079902.061946:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22414
00000004:00000040:20.0:1550079902.061947:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.061948:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3d3a07740 with handle 0x6bcd99f6a809067b from hash
00010000:00000040:20.0:1550079902.061949:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22413
00010000:00000040:20.0:1550079902.061950:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22414
00010000:00010000:20.0:1550079902.061952:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3d3a07740/0x6bcd99f6a809067b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22414 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c2efbd expref: 22414 pid: 21736 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.061955:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22413
00010000:00000040:20.0:1550079902.061956:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22412
00010000:00000040:20.0:1550079902.061956:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22412
00000020:00000040:20.0:1550079902.061957:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22413
00000001:00000040:20.0:1550079902.061959:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 30
00010000:00000040:5.0:1550079902.062263:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265587
00000004:00000040:5.0:1550079902.062264:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.062265:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265588
00010000:00010000:5.0:1550079902.062267:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd48ab3de80/0x6bcd99f6a758ce92 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265588 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef14e0d expref: 265596 pid: 21725 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.062271:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265587
00000020:00000040:5.0:1550079902.062272:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48ab3de80 with handle 0x6bcd99f6a758ce92 from hash
00010000:00000040:5.0:1550079902.062273:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265586
00010000:00000040:5.0:1550079902.062274:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265587
00010000:00010000:5.0:1550079902.062275:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48ab3de80/0x6bcd99f6a758ce92 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265587 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef14e0d expref: 265596 pid: 21725 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.062278:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265586
00010000:00000040:5.0:1550079902.062279:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265585
00010000:00000040:5.0:1550079902.062280:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265593
00000020:00000040:5.0:1550079902.062281:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265595
00000001:00000040:5.0:1550079902.062282:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 40
00010000:00000040:20.0:1550079902.062921:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22413
00000004:00000040:20.0:1550079902.062922:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.062924:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48af81d40 with handle 0x6bcd99f6a7b78a7b from hash
00010000:00000040:20.0:1550079902.062925:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22412
00010000:00000040:20.0:1550079902.062926:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22413
00010000:00010000:20.0:1550079902.062928:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48af81d40/0x6bcd99f6a7b78a7b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22413 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bbefbd expref: 22413 pid: 21895 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.062931:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22412
00010000:00000040:20.0:1550079902.062932:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22411
00010000:00000040:20.0:1550079902.062933:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22411
00000020:00000040:20.0:1550079902.062934:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22412
00000001:00000040:20.0:1550079902.062935:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 31
00010000:00000040:5.0:1550079902.063038:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265586
00000004:00000040:5.0:1550079902.063039:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.063039:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265587
00010000:00010000:5.0:1550079902.063041:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f43a57c0/0x6bcd99f6a73a5210 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265587 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feea4e0d expref: 265595 pid: 21895 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.063044:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265586
00000020:00000040:5.0:1550079902.063046:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3f43a57c0 with handle 0x6bcd99f6a73a5210 from hash
00010000:00000040:5.0:1550079902.063047:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265585
00010000:00000040:5.0:1550079902.063048:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265586
00010000:00010000:5.0:1550079902.063049:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f43a57c0/0x6bcd99f6a73a5210 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265586 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feea4e0d expref: 265595 pid: 21895 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.063052:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265585
00010000:00000040:5.0:1550079902.063053:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265584
00010000:00000040:5.0:1550079902.063054:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265592
00000020:00000040:5.0:1550079902.063055:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265594
00000001:00000040:5.0:1550079902.063056:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 41
00010000:00000040:5.0:1550079902.063808:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265585
00000004:00000040:5.0:1550079902.063809:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.063810:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265586
00010000:00010000:5.0:1550079902.063811:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4612b6c00/0x6bcd99f6a70c91dc lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265586 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee34e0d expref: 265594 pid: 21820 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.063814:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265585
00000020:00000040:5.0:1550079902.063815:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4612b6c00 with handle 0x6bcd99f6a70c91dc from hash
00010000:00000040:5.0:1550079902.063816:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265584
00010000:00000040:5.0:1550079902.063817:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265585
00010000:00010000:5.0:1550079902.063818:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4612b6c00/0x6bcd99f6a70c91dc lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265585 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee34e0d expref: 265594 pid: 21820 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.063821:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265584
00010000:00000040:5.0:1550079902.063822:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265583
00010000:00000040:5.0:1550079902.063822:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265591
00000020:00000040:5.0:1550079902.063823:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265593
00000001:00000040:5.0:1550079902.063824:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 42
00010000:00000040:20.0:1550079902.063900:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22412
00000004:00000040:20.0:1550079902.063901:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.063902:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd471d7b600 with handle 0x6bcd99f6a787474a from hash
00010000:00000040:20.0:1550079902.063904:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22411
00010000:00000040:20.0:1550079902.063904:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22412
00010000:00010000:20.0:1550079902.063906:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd471d7b600/0x6bcd99f6a787474a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22412 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b4efbd expref: 22412 pid: 21808 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.063909:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22411
00010000:00000040:20.0:1550079902.063910:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22410
00010000:00000040:20.0:1550079902.063910:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22410
00000020:00000040:20.0:1550079902.063911:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22411
00000001:00000040:20.0:1550079902.063912:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 32
00010000:00000040:5.0:1550079902.064577:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265584
00000004:00000040:5.0:1550079902.064578:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.064579:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265585
00010000:00010000:5.0:1550079902.064580:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4ae7ea880/0x6bcd99f6a6eba8f3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265585 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedc4e0d expref: 265593 pid: 21458 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.064584:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265584
00000020:00000040:5.0:1550079902.064585:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4ae7ea880 with handle 0x6bcd99f6a6eba8f3 from hash
00010000:00000040:5.0:1550079902.064586:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265583
00010000:00000040:5.0:1550079902.064587:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265584
00010000:00010000:5.0:1550079902.064589:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4ae7ea880/0x6bcd99f6a6eba8f3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265584 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedc4e0d expref: 265593 pid: 21458 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.064592:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265583
00010000:00000040:5.0:1550079902.064592:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265582
00010000:00000040:5.0:1550079902.064593:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265590
00000020:00000040:5.0:1550079902.064594:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265592
00000001:00000040:5.0:1550079902.064595:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 43
00010000:00000040:20.0:1550079902.064875:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22411
00000004:00000040:20.0:1550079902.064876:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.064877:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9fe40b1200 with handle 0x6bcd99f6a755e8a7 from hash
00010000:00000040:20.0:1550079902.064879:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22410
00010000:00000040:20.0:1550079902.064879:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22411
00010000:00010000:20.0:1550079902.064881:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9fe40b1200/0x6bcd99f6a755e8a7 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22411 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52adefbd expref: 22411 pid: 21336 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.064884:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22410
00010000:00000040:20.0:1550079902.064885:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22409
00010000:00000040:20.0:1550079902.064886:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22409
00000020:00000040:20.0:1550079902.064886:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22410
00000001:00000040:20.0:1550079902.064888:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 33
00010000:00000040:5.0:1550079902.065351:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265583
00000004:00000040:5.0:1550079902.065352:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.065353:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265584
00010000:00010000:5.0:1550079902.065355:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4121a57c0/0x6bcd99f6a6c0d67c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265584 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed54e0d expref: 265592 pid: 21828 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.065358:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265583
00000020:00000040:5.0:1550079902.065359:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4121a57c0 with handle 0x6bcd99f6a6c0d67c from hash
00010000:00000040:5.0:1550079902.065360:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265582
00010000:00000040:5.0:1550079902.065361:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265583
00010000:00010000:5.0:1550079902.065362:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4121a57c0/0x6bcd99f6a6c0d67c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265583 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed54e0d expref: 265592 pid: 21828 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.065366:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265582
00010000:00000040:5.0:1550079902.065366:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265581
00010000:00000040:5.0:1550079902.065367:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265589
00000020:00000040:5.0:1550079902.065368:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265591
00000001:00000040:5.0:1550079902.065369:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 44
00010000:00000040:20.0:1550079902.065849:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22410
00000004:00000040:20.0:1550079902.065850:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.065851:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc43ff10fc0 with handle 0x6bcd99f6a7265755 from hash
00010000:00000040:20.0:1550079902.065852:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22409
00010000:00000040:20.0:1550079902.065853:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22410
00010000:00010000:20.0:1550079902.065855:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc43ff10fc0/0x6bcd99f6a7265755 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22410 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a6efbd expref: 22410 pid: 21800 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.065858:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22409
00010000:00000040:20.0:1550079902.065859:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22408
00010000:00000040:20.0:1550079902.065859:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22408
00000020:00000040:20.0:1550079902.065864:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22409
00000001:00000040:20.0:1550079902.065864:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 34
00010000:00000040:5.0:1550079902.066125:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265582
00000004:00000040:5.0:1550079902.066126:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.066126:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265583
00010000:00010000:5.0:1550079902.066128:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e9f369c0/0x6bcd99f6a69700c9 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265583 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fece4e0d expref: 265591 pid: 21341 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.066132:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265582
00000020:00000040:5.0:1550079902.066133:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3e9f369c0 with handle 0x6bcd99f6a69700c9 from hash
00010000:00000040:5.0:1550079902.066134:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265581
00010000:00000040:5.0:1550079902.066135:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265582
00010000:00010000:5.0:1550079902.066136:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e9f369c0/0x6bcd99f6a69700c9 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265582 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fece4e0d expref: 265591 pid: 21341 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.066140:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265581
00010000:00000040:5.0:1550079902.066140:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265580
00010000:00000040:5.0:1550079902.066141:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265588
00000020:00000040:5.0:1550079902.066142:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265590
00000001:00000040:5.0:1550079902.066143:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 45
00010000:00000040:20.0:1550079902.066825:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22409
00000004:00000040:20.0:1550079902.066826:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.066828:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f3b39d40 with handle 0x6bcd99f6a97c6502 from hash
00010000:00000040:20.0:1550079902.066829:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22408
00010000:00000040:20.0:1550079902.066830:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22409
00010000:00010000:20.0:1550079902.066832:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f3b39d40/0x6bcd99f6a97c6502 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22409 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52eaf7bd expref: 22409 pid: 21853 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.066835:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22408
00010000:00000040:20.0:1550079902.066836:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22407
00010000:00000040:20.0:1550079902.066836:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22407
00000020:00000040:20.0:1550079902.066837:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22408
00000001:00000040:20.0:1550079902.066838:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 35
00010000:00000040:5.0:1550079902.066898:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265581
00000004:00000040:5.0:1550079902.066899:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.066900:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265582
00010000:00010000:5.0:1550079902.066902:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca00174a1c0/0x6bcd99f6a89a1295 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265582 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3c560d expref: 265590 pid: 20612 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.066905:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265581
00000020:00000040:5.0:1550079902.066906:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca00174a1c0 with handle 0x6bcd99f6a89a1295 from hash
00010000:00000040:5.0:1550079902.066907:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265580
00010000:00000040:5.0:1550079902.066908:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265581
00010000:00010000:5.0:1550079902.066910:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca00174a1c0/0x6bcd99f6a89a1295 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265581 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3c560d expref: 265590 pid: 20612 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.066913:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265580
00010000:00000040:5.0:1550079902.066913:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265579
00010000:00000040:5.0:1550079902.066914:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265587
00000020:00000040:5.0:1550079902.066916:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265589
00000001:00000040:5.0:1550079902.066917:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 46
00010000:00000040:5.0:1550079902.067669:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265580
00000004:00000040:5.0:1550079902.067670:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.067670:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265581
00010000:00010000:5.0:1550079902.067672:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb49642dc40/0x6bcd99f6a87cf341 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265581 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff35560d expref: 265589 pid: 21833 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.067675:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265580
00000020:00000040:5.0:1550079902.067676:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb49642dc40 with handle 0x6bcd99f6a87cf341 from hash
00010000:00000040:5.0:1550079902.067677:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265579
00010000:00000040:5.0:1550079902.067678:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265580
00010000:00010000:5.0:1550079902.067679:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb49642dc40/0x6bcd99f6a87cf341 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265580 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff35560d expref: 265589 pid: 21833 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.067682:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265579
00010000:00000040:5.0:1550079902.067683:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265578
00010000:00000040:5.0:1550079902.067683:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265586
00000020:00000040:5.0:1550079902.067684:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265588
00000001:00000040:5.0:1550079902.067685:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 47
00010000:00000040:20.0:1550079902.067802:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22408
00000004:00000040:20.0:1550079902.067803:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.067804:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb43b1a0240 with handle 0x6bcd99f6a92b0dfa from hash
00010000:00000040:20.0:1550079902.067805:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22407
00010000:00000040:20.0:1550079902.067807:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22408
00010000:00010000:20.0:1550079902.067808:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb43b1a0240/0x6bcd99f6a92b0dfa lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22408 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e3f7bd expref: 22408 pid: 21895 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.067811:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22407
00010000:00000040:20.0:1550079902.067812:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22406
00010000:00000040:20.0:1550079902.067813:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22406
00000020:00000040:20.0:1550079902.067814:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22407
00000001:00000040:20.0:1550079902.067815:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 36
00010000:00000040:5.0:1550079902.068436:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265579
00000004:00000040:5.0:1550079902.068437:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.068438:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265580
00010000:00010000:5.0:1550079902.068440:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc42e4e2640/0x6bcd99f6a86280f1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265580 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2e560d expref: 265588 pid: 21859 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.068443:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265579
00000020:00000040:5.0:1550079902.068445:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc42e4e2640 with handle 0x6bcd99f6a86280f1 from hash
00010000:00000040:5.0:1550079902.068446:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265578
00010000:00000040:5.0:1550079902.068447:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265579
00010000:00010000:5.0:1550079902.068448:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc42e4e2640/0x6bcd99f6a86280f1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265579 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2e560d expref: 265588 pid: 21859 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.068452:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265578
00010000:00000040:5.0:1550079902.068452:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265577
00010000:00000040:5.0:1550079902.068453:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265585
00000020:00000040:5.0:1550079902.068454:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265587
00000001:00000040:5.0:1550079902.068455:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 48
00010000:00000040:20.0:1550079902.068777:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22407
00000004:00000040:20.0:1550079902.068778:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.068780:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd480a18b40 with handle 0x6bcd99f6a8f81823 from hash
00010000:00000040:20.0:1550079902.068781:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22406
00010000:00000040:20.0:1550079902.068782:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22407
00010000:00010000:20.0:1550079902.068784:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd480a18b40/0x6bcd99f6a8f81823 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22407 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52dcf7bd expref: 22407 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.068787:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22406
00010000:00000040:20.0:1550079902.068787:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22405
00010000:00000040:20.0:1550079902.068788:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22405
00000020:00000040:20.0:1550079902.068789:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22406
00000001:00000040:20.0:1550079902.068790:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 37
00010000:00000040:5.0:1550079902.069210:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265578
00000004:00000040:5.0:1550079902.069211:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.069212:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265579
00010000:00010000:5.0:1550079902.069214:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc41c4e9d40/0x6bcd99f6a84b8586 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265579 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff27560d expref: 265587 pid: 21855 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.069217:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265578
00000020:00000040:5.0:1550079902.069219:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc41c4e9d40 with handle 0x6bcd99f6a84b8586 from hash
00010000:00000040:5.0:1550079902.069220:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265577
00010000:00000040:5.0:1550079902.069220:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265578
00010000:00010000:5.0:1550079902.069222:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc41c4e9d40/0x6bcd99f6a84b8586 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265578 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff27560d expref: 265587 pid: 21855 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.069225:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265577
00010000:00000040:5.0:1550079902.069225:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265576
00010000:00000040:5.0:1550079902.069226:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265584
00000020:00000040:5.0:1550079902.069227:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265586
00000001:00000040:5.0:1550079902.069228:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 49
00010000:00000040:20.0:1550079902.069755:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22406
00000004:00000040:20.0:1550079902.069756:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.069757:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4620086c0 with handle 0x6bcd99f6a8adb218 from hash
00010000:00000040:20.0:1550079902.069759:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22405
00010000:00000040:20.0:1550079902.069760:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22406
00010000:00010000:20.0:1550079902.069761:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4620086c0/0x6bcd99f6a8adb218 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22406 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d5f7bd expref: 22406 pid: 21826 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.069768:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22405
00010000:00000040:20.0:1550079902.069768:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22404
00010000:00000040:20.0:1550079902.069769:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22404
00000020:00000040:20.0:1550079902.069770:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22405
00000001:00000040:20.0:1550079902.069771:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 38
00010000:00000040:5.0:1550079902.069984:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265577
00000004:00000040:5.0:1550079902.069985:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.069986:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265578
00010000:00010000:5.0:1550079902.069988:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb41bb3b600/0x6bcd99f6a83a1737 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265578 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff20560d expref: 265586 pid: 20811 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.069992:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265577
00000020:00000040:5.0:1550079902.069993:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb41bb3b600 with handle 0x6bcd99f6a83a1737 from hash
00010000:00000040:5.0:1550079902.069994:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265576
00010000:00000040:5.0:1550079902.069995:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265577
00010000:00010000:5.0:1550079902.069996:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb41bb3b600/0x6bcd99f6a83a1737 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265577 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff20560d expref: 265586 pid: 20811 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.069999:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265576
00010000:00000040:5.0:1550079902.070000:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265575
00010000:00000040:5.0:1550079902.070000:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265583
00000020:00000040:5.0:1550079902.070001:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265585
00000001:00000040:5.0:1550079902.070002:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 50
00010000:00000040:20.0:1550079902.070736:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22405
00000004:00000040:20.0:1550079902.070737:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.070738:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9fce915e80 with handle 0x6bcd99f6a8700eeb from hash
00010000:00000040:20.0:1550079902.070739:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22404
00010000:00000040:20.0:1550079902.070740:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22405
00010000:00010000:20.0:1550079902.070742:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9fce915e80/0x6bcd99f6a8700eeb lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22405 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cef7bd expref: 22405 pid: 21845 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.070745:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22404
00010000:00000040:20.0:1550079902.070746:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22403
00010000:00000040:20.0:1550079902.070747:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22403
00000020:00000040:20.0:1550079902.070747:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22404
00000001:00000040:20.0:1550079902.070748:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 39
00010000:00000040:5.0:1550079902.070754:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265576
00000004:00000040:5.0:1550079902.070755:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.070756:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265577
00010000:00010000:5.0:1550079902.070757:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb24a646780/0x6bcd99f6a82772e2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265577 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff19560d expref: 265585 pid: 21745 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.070761:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265576
00000020:00000040:5.0:1550079902.070762:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb24a646780 with handle 0x6bcd99f6a82772e2 from hash
00010000:00000040:5.0:1550079902.070763:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265575
00010000:00000040:5.0:1550079902.070764:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265576
00010000:00010000:5.0:1550079902.070765:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb24a646780/0x6bcd99f6a82772e2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265576 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff19560d expref: 265585 pid: 21745 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.070768:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265575
00010000:00000040:5.0:1550079902.070769:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265574
00010000:00000040:5.0:1550079902.070770:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265582
00000020:00000040:5.0:1550079902.070771:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265584
00000001:00000040:5.0:1550079902.070772:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 51
00000100:00000040:33.0F:1550079902.070820:0:20241:0:(events.c:348:request_in_callback()) incoming req@ffff9cc3fbf91e00 x1624700722815328 msgsize 224
00000020:00000040:1.0:1550079902.070828:0:20811:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13a3f
00000020:00000040:1.0:1550079902.070832:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca4833a4400 : new refcount 9
00000100:00000040:1.0:1550079902.070837:0:20811:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +7s
00000100:00000040:1.0:1550079902.070842:0:20811:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca4833a4400 : new rpc_count 1
00000100:00000040:1.0:1550079902.070845:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cc3fbf91e00 x1624700722815328/t0(0) o400->7e9161e5-27d8-4cac-a415-4c23ea14bc0e@10.9.106.46@o2ib4:739/0 lens 224/0 e 0 to 0 dl 1550079914 ref 1 fl New:H/0/ffffffff rc 0/-1
00010000:00000040:1.0:1550079902.070853:0:20811:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38740809260, transno 0, xid 1624700722815328
00000100:00000040:1.0:1550079902.070856:0:20811:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4827dd780 refcount 6 to 10.9.106.46@o2ib4
00000100:00000040:32.0F:1550079902.070857:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9cd47177f050 x1624700722815312 msgsize 224
00000100:00000040:1.0:1550079902.070859:0:20811:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.9.106.46@o2ib4
00000100:00000040:32.0:1550079902.070866:0:20238:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:11.0:1550079902.070875:0:38445:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f60a12277c
00000100:00000040:1.0:1550079902.070875:0:20811:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4827dd780 refcount 5 to 10.9.106.46@o2ib4
00000100:00000040:1.0:1550079902.070876:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cc3fbf91e00 x1624700722815328/t0(0) o400->7e9161e5-27d8-4cac-a415-4c23ea14bc0e@10.9.106.46@o2ib4:739/0 lens 224/192 e 0 to 0 dl 1550079914 ref 1 fl Interpret:H/0/0 rc 0/0
00000020:00000040:11.0:1550079902.070879:0:38445:0:(genops.c:1008:class_export_get()) GETting export ffff9c9e5eec0c00 : new refcount 17
00000100:00000040:1.0:1550079902.070881:0:20811:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca4833a4400 : new rpc_count 0
00000100:00000040:11.0:1550079902.070884:0:38445:0:(service.c:1210:ptlrpc_at_set_timer()) armed mgs at +38s
00000020:00000040:1.0:1550079902.070884:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca4833a4400 : new refcount 8
00000100:00000040:11.0:1550079902.070889:0:38445:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9c9e5eec0c00 : new rpc_count 1
00000100:00000040:11.0:1550079902.070892:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cd47177f050 x1624700722815312/t0(0) o400->3c437012-1958-16b8-8e42-05966dc30ed0@10.9.106.46@o2ib4:15/0 lens 224/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00000040:11.0:1550079902.070901:0:38445:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 0, transno 0, xid 1624700722815312
00000100:00000040:11.0:1550079902.070904:0:38445:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4827dd780 refcount 6 to 10.9.106.46@o2ib4
00000100:00000040:11.0:1550079902.070907:0:38445:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.9.106.46@o2ib4
00000100:00000040:11.0:1550079902.070922:0:38445:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4827dd780 refcount 5 to 10.9.106.46@o2ib4
00000100:00000040:11.0:1550079902.070924:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd47177f050 x1624700722815312/t0(0) o400->3c437012-1958-16b8-8e42-05966dc30ed0@10.9.106.46@o2ib4:15/0 lens 224/192 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:11.0:1550079902.070929:0:38445:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c9e5eec0c00 : new rpc_count 0
00000020:00000040:11.0:1550079902.070932:0:38445:0:(genops.c:1018:class_export_put()) PUTting export ffff9c9e5eec0c00 : new refcount 16
00010000:00000040:5.0:1550079902.071529:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265575
00000004:00000040:5.0:1550079902.071530:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.071531:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265576
00010000:00010000:5.0:1550079902.071532:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4290b4c80/0x6bcd99f6a81440e2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265576 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff12560d expref: 265584 pid: 21346 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.071536:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265575
00000020:00000040:5.0:1550079902.071537:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4290b4c80 with handle 0x6bcd99f6a81440e2 from hash
00010000:00000040:5.0:1550079902.071538:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265574
00010000:00000040:5.0:1550079902.071538:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265575
00010000:00010000:5.0:1550079902.071540:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4290b4c80/0x6bcd99f6a81440e2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265575 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff12560d expref: 265584 pid: 21346 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.071543:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265574
00010000:00000040:5.0:1550079902.071543:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265573
00010000:00000040:5.0:1550079902.071544:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265581
00000020:00000040:5.0:1550079902.071545:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265583
00000001:00000040:5.0:1550079902.071546:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 52
00010000:00000040:20.0:1550079902.071713:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22404
00000004:00000040:20.0:1550079902.071714:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.071716:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd499c9b3c0 with handle 0x6bcd99f6a823f91e from hash
00010000:00000040:20.0:1550079902.071717:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22403
00010000:00000040:20.0:1550079902.071718:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22404
00010000:00010000:20.0:1550079902.071719:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd499c9b3c0/0x6bcd99f6a823f91e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22404 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c7f7bd expref: 22404 pid: 20535 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.071722:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22403
00010000:00000040:20.0:1550079902.071723:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22402
00010000:00000040:20.0:1550079902.071724:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22402
00000020:00000040:20.0:1550079902.071725:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22403
00000001:00000040:20.0:1550079902.071727:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 40
00010000:00000040:5.0:1550079902.072297:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265574
00000004:00000040:5.0:1550079902.072298:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.072299:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265575
00010000:00010000:5.0:1550079902.072301:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46462cec0/0x6bcd99f6a7fd7a98 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265575 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0b560d expref: 265583 pid: 21458 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.072304:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265574
00000020:00000040:5.0:1550079902.072305:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46462cec0 with handle 0x6bcd99f6a7fd7a98 from hash
00010000:00000040:5.0:1550079902.072306:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265573
00010000:00000040:5.0:1550079902.072307:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265574
00010000:00010000:5.0:1550079902.072309:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46462cec0/0x6bcd99f6a7fd7a98 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265574 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0b560d expref: 265583 pid: 21458 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.072312:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265573
00010000:00000040:5.0:1550079902.072313:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265572
00010000:00000040:5.0:1550079902.072314:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265580
00000020:00000040:5.0:1550079902.072315:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265582
00000001:00000040:5.0:1550079902.072315:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 53
00010000:00000040:20.0:1550079902.072691:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22403
00000004:00000040:20.0:1550079902.072692:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.072694:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca47a50d7c0 with handle 0x6bcd99f6a7ee6554 from hash
00010000:00000040:20.0:1550079902.072695:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22402
00010000:00000040:20.0:1550079902.072696:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22403
00010000:00010000:20.0:1550079902.072697:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca47a50d7c0/0x6bcd99f6a7ee6554 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22403 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c0f7bd expref: 22403 pid: 21320 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.072701:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22402
00010000:00000040:20.0:1550079902.072701:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22401
00010000:00000040:20.0:1550079902.072702:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22401
00000020:00000040:20.0:1550079902.072703:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22402
00000001:00000040:20.0:1550079902.072704:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 41
00010000:00000040:5.0:1550079902.073071:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265573
00000004:00000040:5.0:1550079902.073072:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.073073:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265574
00010000:00010000:5.0:1550079902.073075:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd474642640/0x6bcd99f6a7d62676 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265574 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff04560d expref: 265582 pid: 21859 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.073078:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265573
00000020:00000040:5.0:1550079902.073080:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd474642640 with handle 0x6bcd99f6a7d62676 from hash
00010000:00000040:5.0:1550079902.073081:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265572
00010000:00000040:5.0:1550079902.073081:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265573
00010000:00010000:5.0:1550079902.073083:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd474642640/0x6bcd99f6a7d62676 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265573 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff04560d expref: 265582 pid: 21859 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.073086:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265572
00010000:00000040:5.0:1550079902.073086:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265571
00010000:00000040:5.0:1550079902.073087:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265579
00000020:00000040:5.0:1550079902.073088:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265581
00000001:00000040:5.0:1550079902.073089:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 54
00010000:00000040:20.0:1550079902.073668:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22402
00000004:00000040:20.0:1550079902.073669:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.073671:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48ca44140 with handle 0x6bcd99f6a7a83002 from hash
00010000:00000040:20.0:1550079902.073672:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22401
00010000:00000040:20.0:1550079902.073673:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22402
00010000:00010000:20.0:1550079902.073674:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48ca44140/0x6bcd99f6a7a83002 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22402 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b9f7bd expref: 22402 pid: 21711 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.073677:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22401
00010000:00000040:20.0:1550079902.073678:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22400
00010000:00000040:20.0:1550079902.073679:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22400
00000020:00000040:20.0:1550079902.073680:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22401
00000001:00000040:20.0:1550079902.073681:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 42
00010000:00000040:5.0:1550079902.073841:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265572
00000004:00000040:5.0:1550079902.073842:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.073842:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265573
00010000:00010000:5.0:1550079902.073844:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca2b5552f40/0x6bcd99f6a79ea8c8 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265573 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefd560d expref: 265581 pid: 21797 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.073848:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265572
00000020:00000040:5.0:1550079902.073849:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca2b5552f40 with handle 0x6bcd99f6a79ea8c8 from hash
00010000:00000040:5.0:1550079902.073850:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265571
00010000:00000040:5.0:1550079902.073851:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265572
00010000:00010000:5.0:1550079902.073852:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca2b5552f40/0x6bcd99f6a79ea8c8 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265572 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefd560d expref: 265581 pid: 21797 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.073855:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265571
00010000:00000040:5.0:1550079902.073856:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265570
00010000:00000040:5.0:1550079902.073857:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265578
00000020:00000040:5.0:1550079902.073858:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265580
00000001:00000040:5.0:1550079902.073859:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 55
00010000:00000040:5.0:1550079902.074614:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265571
00000004:00000040:5.0:1550079902.074615:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.074616:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265572
00010000:00010000:5.0:1550079902.074618:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc445a4ad00/0x6bcd99f6a7793561 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265572 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef6560d expref: 265580 pid: 21849 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.074621:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265571
00000020:00000040:5.0:1550079902.074622:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc445a4ad00 with handle 0x6bcd99f6a7793561 from hash
00010000:00000040:5.0:1550079902.074623:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265570
00010000:00000040:5.0:1550079902.074624:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265571
00010000:00010000:5.0:1550079902.074625:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc445a4ad00/0x6bcd99f6a7793561 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265571 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef6560d expref: 265580 pid: 21849 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.074628:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265570
00010000:00000040:5.0:1550079902.074629:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265569
00010000:00000040:5.0:1550079902.074630:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265577
00000020:00000040:5.0:1550079902.074631:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265579
00000001:00000040:5.0:1550079902.074632:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 56
00010000:00000040:20.0:1550079902.074645:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22401
00000004:00000040:20.0:1550079902.074646:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.074648:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb404ec0240 with handle 0x6bcd99f6a7750e2c from hash
00010000:00000040:20.0:1550079902.074649:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22400
00010000:00000040:20.0:1550079902.074650:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22401
00010000:00010000:20.0:1550079902.074651:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb404ec0240/0x6bcd99f6a7750e2c lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22401 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b2f7bd expref: 22401 pid: 21745 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.074655:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22400
00010000:00000040:20.0:1550079902.074655:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22399
00010000:00000040:20.0:1550079902.074656:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22399
00000020:00000040:20.0:1550079902.074657:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22400
00000001:00000040:20.0:1550079902.074658:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 43
00010000:00000040:5.0:1550079902.075383:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265570
00000004:00000040:5.0:1550079902.075384:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.075385:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265571
00010000:00010000:5.0:1550079902.075387:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9ee630e540/0x6bcd99f6a74dbf2e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265571 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feef560d expref: 265579 pid: 21346 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.075390:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265570
00000020:00000040:5.0:1550079902.075391:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9ee630e540 with handle 0x6bcd99f6a74dbf2e from hash
00010000:00000040:5.0:1550079902.075392:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265569
00010000:00000040:5.0:1550079902.075393:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265570
00010000:00010000:5.0:1550079902.075395:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9ee630e540/0x6bcd99f6a74dbf2e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265570 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feef560d expref: 265579 pid: 21346 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.075398:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265569
00010000:00000040:5.0:1550079902.075398:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265568
00010000:00000040:5.0:1550079902.075399:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265576
00000020:00000040:5.0:1550079902.075400:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265578
00000001:00000040:5.0:1550079902.075401:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 57
00010000:00000040:20.0:1550079902.075622:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22400
00000004:00000040:20.0:1550079902.075623:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.075625:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46e6ad580 with handle 0x6bcd99f6a74f0d05 from hash
00010000:00000040:20.0:1550079902.075626:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22399
00010000:00000040:20.0:1550079902.075627:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22400
00010000:00010000:20.0:1550079902.075628:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46e6ad580/0x6bcd99f6a74f0d05 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22400 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52abf7bd expref: 22400 pid: 20535 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.075631:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22399
00010000:00000040:20.0:1550079902.075632:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22398
00010000:00000040:20.0:1550079902.075633:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22398
00000020:00000040:20.0:1550079902.075634:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22399
00000001:00000040:20.0:1550079902.075635:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 44
00010000:00000040:5.0:1550079902.076157:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265569
00000004:00000040:5.0:1550079902.076158:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.076159:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265570
00010000:00010000:5.0:1550079902.076161:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca07f7f2880/0x6bcd99f6a72d9505 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265570 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee8560d expref: 265578 pid: 21320 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.076164:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265569
00000020:00000040:5.0:1550079902.076165:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca07f7f2880 with handle 0x6bcd99f6a72d9505 from hash
00010000:00000040:5.0:1550079902.076166:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265568
00010000:00000040:5.0:1550079902.076167:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265569
00010000:00010000:5.0:1550079902.076169:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca07f7f2880/0x6bcd99f6a72d9505 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265569 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee8560d expref: 265578 pid: 21320 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.076172:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265568
00010000:00000040:5.0:1550079902.076173:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265567
00010000:00000040:5.0:1550079902.076173:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265575
00000020:00000040:5.0:1550079902.076174:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265577
00000001:00000040:5.0:1550079902.076175:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 58
00010000:00000040:20.0:1550079902.076600:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22399
00000004:00000040:20.0:1550079902.076601:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.076602:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd467aad580 with handle 0x6bcd99f6a718375e from hash
00010000:00000040:20.0:1550079902.076604:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22398
00010000:00000040:20.0:1550079902.076604:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22399
00010000:00010000:20.0:1550079902.076607:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd467aad580/0x6bcd99f6a718375e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22399 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a4f7bd expref: 22399 pid: 20808 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.076610:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22398
00010000:00000040:20.0:1550079902.076611:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22397
00010000:00000040:20.0:1550079902.076611:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22397
00000020:00000040:20.0:1550079902.076612:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22398
00000001:00000040:20.0:1550079902.076613:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 45
00010000:00000040:5.0:1550079902.076931:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265568
00000004:00000040:5.0:1550079902.076932:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.076933:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265569
00010000:00010000:5.0:1550079902.076934:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f64ade80/0x6bcd99f6a705b2d6 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265569 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee1560d expref: 265577 pid: 21758 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.076938:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265568
00000020:00000040:5.0:1550079902.076939:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f64ade80 with handle 0x6bcd99f6a705b2d6 from hash
00010000:00000040:5.0:1550079902.076940:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265567
00010000:00000040:5.0:1550079902.076941:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265568
00010000:00010000:5.0:1550079902.076942:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f64ade80/0x6bcd99f6a705b2d6 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265568 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee1560d expref: 265577 pid: 21758 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.076945:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265567
00010000:00000040:5.0:1550079902.076946:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265566
00010000:00000040:5.0:1550079902.076947:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265574
00000020:00000040:5.0:1550079902.076948:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265576
00000001:00000040:5.0:1550079902.076949:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 59
00010000:00000040:20.0:1550079902.077578:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22398
00000004:00000040:20.0:1550079902.077579:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.077581:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4c8b81b00 with handle 0x6bcd99f6a9153475 from hash
00010000:00000040:20.0:1550079902.077582:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22397
00010000:00000040:20.0:1550079902.077583:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22398
00010000:00010000:20.0:1550079902.077584:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4c8b81b00/0x6bcd99f6a9153475 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22398 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e1ffbd expref: 22398 pid: 21356 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.077587:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22397
00010000:00000040:20.0:1550079902.077588:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22396
00010000:00000040:20.0:1550079902.077589:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22396
00000020:00000040:20.0:1550079902.077590:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22397
00000001:00000040:20.0:1550079902.077591:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 46
00010000:00000040:5.0:1550079902.077701:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265567
00000004:00000040:5.0:1550079902.077702:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.077702:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265568
00010000:00010000:5.0:1550079902.077704:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc447cd33c0/0x6bcd99f6a6e090dd lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265568 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feda560d expref: 265576 pid: 20532 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.077708:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265567
00000020:00000040:5.0:1550079902.077709:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc447cd33c0 with handle 0x6bcd99f6a6e090dd from hash
00010000:00000040:5.0:1550079902.077711:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265566
00010000:00000040:5.0:1550079902.077712:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265567
00010000:00010000:5.0:1550079902.077713:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc447cd33c0/0x6bcd99f6a6e090dd lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265567 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feda560d expref: 265576 pid: 20532 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.077716:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265566
00010000:00000040:5.0:1550079902.077716:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265565
00010000:00000040:5.0:1550079902.077717:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265573
00000020:00000040:5.0:1550079902.077718:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265575
00000001:00000040:5.0:1550079902.077719:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 60
00010000:00000040:5.0:1550079902.078477:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265566
00000004:00000040:5.0:1550079902.078478:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.078479:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265567
00010000:00010000:5.0:1550079902.078480:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd474c406c0/0x6bcd99f6a6ba35f8 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265567 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed3560d expref: 265575 pid: 21736 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.078483:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265566
00000020:00000040:5.0:1550079902.078484:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd474c406c0 with handle 0x6bcd99f6a6ba35f8 from hash
00010000:00000040:5.0:1550079902.078485:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265565
00010000:00000040:5.0:1550079902.078486:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265566
00010000:00010000:5.0:1550079902.078487:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd474c406c0/0x6bcd99f6a6ba35f8 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265566 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed3560d expref: 265575 pid: 21736 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.078490:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265565
00010000:00000040:5.0:1550079902.078491:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265564
00010000:00000040:5.0:1550079902.078492:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265572
00000020:00000040:5.0:1550079902.078493:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265574
00000001:00000040:5.0:1550079902.078494:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 61
00010000:00000040:20.0:1550079902.078556:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22397
00000004:00000040:20.0:1550079902.078557:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.078558:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca039634c80 with handle 0x6bcd99f6a8e15893 from hash
00010000:00000040:20.0:1550079902.078560:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22396
00010000:00000040:20.0:1550079902.078560:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22397
00010000:00010000:20.0:1550079902.078562:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca039634c80/0x6bcd99f6a8e15893 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22397 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52daffbd expref: 22397 pid: 21840 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.078565:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22396
00010000:00000040:20.0:1550079902.078567:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22395
00010000:00000040:20.0:1550079902.078567:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22395
00000020:00000040:20.0:1550079902.078568:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22396
00000001:00000040:20.0:1550079902.078569:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 47
00010000:00000040:5.0:1550079902.079246:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265565
00000004:00000040:5.0:1550079902.079247:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.079248:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265566
00010000:00010000:5.0:1550079902.079249:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4935fc5c0/0x6bcd99f6a6868b16 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265566 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecc560d expref: 265574 pid: 20793 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.079253:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265565
00000020:00000040:5.0:1550079902.079254:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4935fc5c0 with handle 0x6bcd99f6a6868b16 from hash
00010000:00000040:5.0:1550079902.079255:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265564
00010000:00000040:5.0:1550079902.079256:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265565
00010000:00010000:5.0:1550079902.079257:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4935fc5c0/0x6bcd99f6a6868b16 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265565 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecc560d expref: 265574 pid: 20793 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.079260:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265564
00010000:00000040:5.0:1550079902.079261:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265563
00010000:00000040:5.0:1550079902.079262:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265571
00000020:00000040:5.0:1550079902.079263:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265573
00000001:00000040:5.0:1550079902.079263:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 62
00000100:00000040:17.0:1550079902.079284:0:20243:0:(events.c:348:request_in_callback()) incoming req@ffff9cb3da387200 x1625285162576528 msgsize 392
00000020:00000040:1.0:1550079902.079290:0:21962:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:1.0:1550079902.079292:0:21962:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40334
00000100:00000040:1.0:1550079902.079295:0:21962:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt_readpage at +43s
00000100:00000040:1.0:1550079902.079300:0:21962:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:1.0:1550079902.079303:0:21962:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb3da387200 x1625285162576528/t0(0) o35->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:20/0 lens 392/0 e 0 to 0 dl 1550079950 ref 1 fl New:/0/ffffffff rc 0/-1
00000020:00000040:1.0:1550079902.079312:0:21962:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb26b283900 with handle 0x6bcd99f6a9ded6b4 from hash
00000004:00000040:1.0:1550079902.079320:0:21962:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000004:00000040:1.0:1550079902.079327:0:21962:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00000001:00000040:1.0:1550079902.079335:0:21962:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff9ca482e32c00 : new cb_count 21
00000020:00000040:1.0:1550079902.079336:0:21962:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40335
00000004:00000040:1.0:1550079902.079345:0:21962:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00010000:00000040:1.0:1550079902.079346:0:21962:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 38754597597, xid 1625285162576528
00000100:00000040:1.0:1550079902.079349:0:21962:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.079351:0:21962:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.079358:0:21962:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.079361:0:21962:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb3da387200 x1625285162576528/t38754597597(0) o35->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:20/0 lens 392/424 e 0 to 0 dl 1550079950 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:1.0:1550079902.079366:0:21962:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:1.0:1550079902.079367:0:21962:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40334
00000100:00000040:33.0:1550079902.079389:0:20241:0:(events.c:348:request_in_callback()) incoming req@ffff9cd47177c050 x1624736698722016 msgsize 224
00000100:00000040:33.0:1550079902.079391:0:20241:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:11.0:1550079902.079399:0:38445:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f60a26b53e
00000020:00000040:11.0:1550079902.079401:0:38445:0:(genops.c:1008:class_export_get()) GETting export ffff9c9e5bb08800 : new refcount 13
00000100:00000040:11.0:1550079902.079404:0:38445:0:(service.c:1210:ptlrpc_at_set_timer()) armed mgs at +38s
00000100:00000040:11.0:1550079902.079408:0:38445:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9c9e5bb08800 : new rpc_count 1
00000100:00000040:11.0:1550079902.079410:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cd47177c050 x1624736698722016/t0(0) o400->468bffcc-2d7b-a02c-62b9-3f358b31c1f8@10.8.20.30@o2ib6:15/0 lens 224/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:9.0:1550079902.079411:0:20242:0:(events.c:348:request_in_callback()) incoming req@ffff9cb3c5258c00 x1624736698722064 msgsize 520
00010000:00000040:11.0:1550079902.079415:0:38445:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 0, transno 0, xid 1624736698722016
00000100:00000040:11.0:1550079902.079418:0:38445:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4fc11f480 refcount 6 to 10.8.20.30@o2ib6
00000020:00000040:1.0:1550079902.079418:0:20811:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa1b9dc
00000100:00000040:11.0:1550079902.079420:0:38445:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.20.30@o2ib6
00000100:00000040:1.0:1550079902.079424:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb3c5258c00 x1624736698722064/t0(0) o38-><?>@<?>:0/0 lens 520/0 e 0 to 0 dl 1550080002 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:11.0:1550079902.079430:0:38445:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4fc11f480 refcount 5 to 10.8.20.30@o2ib6
00000100:00000040:11.0:1550079902.079432:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd47177c050 x1624736698722016/t0(0) o400->468bffcc-2d7b-a02c-62b9-3f358b31c1f8@10.8.20.30@o2ib6:15/0 lens 224/192 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 0/0
00000020:00000040:1.0:1550079902.079433:0:20811:0:(obd_config.c:705:class_incref()) incref fir-MDT0002 (ffff9ca480991038) now 9
00010000:02000000:1.0:1550079902.079435:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.30@o2ib6 (stopping)
00000100:00000040:11.0:1550079902.079436:0:38445:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c9e5bb08800 : new rpc_count 0
00000020:00000040:1.0:1550079902.079437:0:20811:0:(obd_config.c:716:class_decref()) Decref fir-MDT0002 (ffff9ca480991038) now 9 - find
00000020:00000040:11.0:1550079902.079438:0:38445:0:(genops.c:1018:class_export_put()) PUTting export ffff9c9e5bb08800 : new refcount 12
00000100:00000040:1.0:1550079902.079442:0:20811:0:(connection.c:84:ptlrpc_connection_get()) conn=ffff9cb4fc11f480 refcount 6 to 10.8.20.30@o2ib6
00000100:00000040:1.0:1550079902.079444:0:20811:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.20.30@o2ib6
00000100:00000040:1.0:1550079902.079450:0:20811:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4fc11f480 refcount 5 to 10.8.20.30@o2ib6
00000100:00000040:1.0:1550079902.079451:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb3c5258c00 x1624736698722064/t0(0) o38-><?>@<?>:0/0 lens 520/192 e 0 to 0 dl 1550080002 ref 1 fl Interpret:/0/0 rc -19/-19
00000100:00000040:22.0:1550079902.079466:0:20244:0:(events.c:348:request_in_callback()) incoming req@ffff9cc2ca326c00 x1624736698722032 msgsize 224
00000020:00000040:30.0:1550079902.079473:0:21149:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa149f1
00000020:00000040:30.0:1550079902.079476:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482ff3c00 : new refcount 9
00000100:00000040:30.0:1550079902.079480:0:21149:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +21s
00000100:00000040:30.0:1550079902.079484:0:21149:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482ff3c00 : new rpc_count 1
00000100:00000040:30.0:1550079902.079487:0:21149:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cc2ca326c00 x1624736698722032/t0(0) o400->7648c697-029a-1f3f-4734-502e908d693b@10.8.20.30@o2ib6:753/0 lens 224/0 e 0 to 0 dl 1550079928 ref 1 fl New:H/0/ffffffff rc 0/-1
00010000:00000040:30.0:1550079902.079495:0:21149:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 21481231979, transno 0, xid 1624736698722032
00000100:00000040:30.0:1550079902.079498:0:21149:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4fc11f480 refcount 6 to 10.8.20.30@o2ib6
00000100:00000040:30.0:1550079902.079501:0:21149:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.20.30@o2ib6
00000100:00000040:30.0:1550079902.079508:0:21149:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4fc11f480 refcount 5 to 10.8.20.30@o2ib6
00000100:00000040:30.0:1550079902.079509:0:21149:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cc2ca326c00 x1624736698722032/t0(0) o400->7648c697-029a-1f3f-4734-502e908d693b@10.8.20.30@o2ib6:753/0 lens 224/192 e 0 to 0 dl 1550079928 ref 1 fl Interpret:H/0/0 rc 0/0
00000100:00000040:30.0:1550079902.079514:0:21149:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482ff3c00 : new rpc_count 0
00000020:00000040:30.0:1550079902.079516:0:21149:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482ff3c00 : new refcount 8
00010000:00000040:20.0:1550079902.079534:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22396
00000004:00000040:20.0:1550079902.079535:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.079536:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd462076e40 with handle 0x6bcd99f6a89a3fba from hash
00010000:00000040:20.0:1550079902.079538:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22395
00010000:00000040:20.0:1550079902.079539:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22396
00010000:00010000:20.0:1550079902.079540:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd462076e40/0x6bcd99f6a89a3fba lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22396 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d3ffbd expref: 22396 pid: 20644 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.079543:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22395
00010000:00000040:20.0:1550079902.079544:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22394
00010000:00000040:20.0:1550079902.079545:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22394
00000020:00000040:20.0:1550079902.079546:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22395
00000001:00000040:20.0:1550079902.079547:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 48
00010000:00000040:5.0:1550079902.080020:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265564
00000004:00000040:5.0:1550079902.080021:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.080022:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265565
00010000:00010000:5.0:1550079902.080023:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc472f17500/0x6bcd99f6a8900ad0 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265565 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3a5e0d expref: 265573 pid: 21803 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.080027:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265564
00000020:00000040:5.0:1550079902.080028:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc472f17500 with handle 0x6bcd99f6a8900ad0 from hash
00010000:00000040:5.0:1550079902.080029:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265563
00010000:00000040:5.0:1550079902.080030:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265564
00010000:00010000:5.0:1550079902.080032:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc472f17500/0x6bcd99f6a8900ad0 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265564 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3a5e0d expref: 265573 pid: 21803 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.080035:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265563
00010000:00000040:5.0:1550079902.080036:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265562
00010000:00000040:5.0:1550079902.080037:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265570
00000020:00000040:5.0:1550079902.080038:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265572
00000001:00000040:5.0:1550079902.080039:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 63
00010000:00000040:20.0:1550079902.080512:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22395
00000004:00000040:20.0:1550079902.080513:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.080515:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc42bd4b3c0 with handle 0x6bcd99f6a85d3b3a from hash
00010000:00000040:20.0:1550079902.080516:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22394
00010000:00000040:20.0:1550079902.080517:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22395
00010000:00010000:20.0:1550079902.080518:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc42bd4b3c0/0x6bcd99f6a85d3b3a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22395 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ccffbd expref: 22395 pid: 21356 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.080521:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22394
00010000:00000040:20.0:1550079902.080522:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22393
00010000:00000040:20.0:1550079902.080523:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22393
00000020:00000040:20.0:1550079902.080523:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22394
00000001:00000040:20.0:1550079902.080525:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 49
00010000:00000040:5.0:1550079902.080791:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265563
00000004:00000040:5.0:1550079902.080792:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.080792:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265564
00010000:00010000:5.0:1550079902.080794:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3ef1de9c0/0x6bcd99f6a873cd7b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265564 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff335e0d expref: 265572 pid: 21356 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.080798:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265563
00000020:00000040:5.0:1550079902.080799:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3ef1de9c0 with handle 0x6bcd99f6a873cd7b from hash
00010000:00000040:5.0:1550079902.080800:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265562
00010000:00000040:5.0:1550079902.080801:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265563
00010000:00010000:5.0:1550079902.080802:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3ef1de9c0/0x6bcd99f6a873cd7b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265563 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff335e0d expref: 265572 pid: 21356 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.080805:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265562
00010000:00000040:5.0:1550079902.080806:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265561
00010000:00000040:5.0:1550079902.080806:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265569
00000020:00000040:5.0:1550079902.080807:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265571
00000001:00000040:5.0:1550079902.080808:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 64
00010000:00000040:20.0:1550079902.081489:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22394
00000004:00000040:20.0:1550079902.081490:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.081492:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e7f81d40 with handle 0x6bcd99f6a81a639e from hash
00010000:00000040:20.0:1550079902.081493:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22393
00010000:00000040:20.0:1550079902.081494:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22394
00010000:00010000:20.0:1550079902.081496:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e7f81d40/0x6bcd99f6a81a639e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22394 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c5ffbd expref: 22394 pid: 21800 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.081499:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22393
00010000:00000040:20.0:1550079902.081500:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22392
00010000:00000040:20.0:1550079902.081500:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22392
00000020:00000040:20.0:1550079902.081501:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22393
00000001:00000040:20.0:1550079902.081502:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 50
00010000:00000040:5.0:1550079902.081565:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265562
00000004:00000040:5.0:1550079902.081566:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.081566:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265563
00010000:00010000:5.0:1550079902.081568:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9da98e1680/0x6bcd99f6a85ca73e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265563 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2c5e0d expref: 265571 pid: 21329 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.081572:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265562
00000020:00000040:5.0:1550079902.081574:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9da98e1680 with handle 0x6bcd99f6a85ca73e from hash
00010000:00000040:5.0:1550079902.081575:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265561
00010000:00000040:5.0:1550079902.081575:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265562
00010000:00010000:5.0:1550079902.081577:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9da98e1680/0x6bcd99f6a85ca73e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265562 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2c5e0d expref: 265571 pid: 21329 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.081580:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265561
00010000:00000040:5.0:1550079902.081581:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265560
00010000:00000040:5.0:1550079902.081581:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265568
00000020:00000040:5.0:1550079902.081582:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265570
00000001:00000040:5.0:1550079902.081583:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 65
00010000:00000040:5.0:1550079902.082340:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265561
00000004:00000040:5.0:1550079902.082340:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.082341:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265562
00010000:00010000:5.0:1550079902.082342:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9da7d7a640/0x6bcd99f6a8466c92 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265562 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff255e0d expref: 265570 pid: 21845 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.082346:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265561
00000020:00000040:5.0:1550079902.082347:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9da7d7a640 with handle 0x6bcd99f6a8466c92 from hash
00010000:00000040:5.0:1550079902.082348:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265560
00010000:00000040:5.0:1550079902.082349:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265561
00010000:00010000:5.0:1550079902.082350:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9da7d7a640/0x6bcd99f6a8466c92 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265561 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff255e0d expref: 265570 pid: 21845 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.082353:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265560
00010000:00000040:5.0:1550079902.082353:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265559
00010000:00000040:5.0:1550079902.082354:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265567
00000020:00000040:5.0:1550079902.082355:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265569
00000001:00000040:5.0:1550079902.082356:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 66
00010000:00000040:20.0:1550079902.082467:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22393
00000004:00000040:20.0:1550079902.082468:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.082469:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb434d49680 with handle 0x6bcd99f6a7cf6a2a from hash
00010000:00000040:20.0:1550079902.082470:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22392
00010000:00000040:20.0:1550079902.082471:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22393
00010000:00010000:20.0:1550079902.082473:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb434d49680/0x6bcd99f6a7cf6a2a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22393 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52beffbd expref: 22393 pid: 21888 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.082476:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22392
00010000:00000040:20.0:1550079902.082477:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22391
00010000:00000040:20.0:1550079902.082477:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22391
00000020:00000040:20.0:1550079902.082478:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22392
00000001:00000040:20.0:1550079902.082479:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 51
00010000:00000040:5.0:1550079902.083108:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265560
00000004:00000040:5.0:1550079902.083109:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.083110:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265561
00010000:00010000:5.0:1550079902.083112:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd49a3bb3c0/0x6bcd99f6a8367215 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265561 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1e5e0d expref: 265569 pid: 21866 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.083115:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265560
00000020:00000040:5.0:1550079902.083117:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd49a3bb3c0 with handle 0x6bcd99f6a8367215 from hash
00010000:00000040:5.0:1550079902.083118:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265559
00010000:00000040:5.0:1550079902.083119:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265560
00010000:00010000:5.0:1550079902.083120:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd49a3bb3c0/0x6bcd99f6a8367215 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265560 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1e5e0d expref: 265569 pid: 21866 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.083123:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265559
00010000:00000040:5.0:1550079902.083124:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265558
00010000:00000040:5.0:1550079902.083125:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265566
00000020:00000040:5.0:1550079902.083125:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265568
00000001:00000040:5.0:1550079902.083127:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 67
00010000:00000040:20.0:1550079902.083445:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22392
00000004:00000040:20.0:1550079902.083446:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.083448:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45370da00 with handle 0x6bcd99f6a79fe0bf from hash
00010000:00000040:20.0:1550079902.083449:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22391
00010000:00000040:20.0:1550079902.083450:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22392
00010000:00010000:20.0:1550079902.083452:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45370da00/0x6bcd99f6a79fe0bf lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22392 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b7ffbd expref: 22392 pid: 21820 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.083455:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22391
00010000:00000040:20.0:1550079902.083456:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22390
00010000:00000040:20.0:1550079902.083457:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22390
00000020:00000040:20.0:1550079902.083458:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22391
00000001:00000040:20.0:1550079902.083459:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 52
00010000:00000040:5.0:1550079902.083883:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265559
00000004:00000040:5.0:1550079902.083884:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.083884:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265560
00010000:00010000:5.0:1550079902.083886:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca4545dcec0/0x6bcd99f6a822d5b0 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265560 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff175e0d expref: 265568 pid: 21343 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.083889:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265559
00000020:00000040:5.0:1550079902.083891:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca4545dcec0 with handle 0x6bcd99f6a822d5b0 from hash
00010000:00000040:5.0:1550079902.083892:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265558
00010000:00000040:5.0:1550079902.083893:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265559
00010000:00010000:5.0:1550079902.083894:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca4545dcec0/0x6bcd99f6a822d5b0 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265559 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff175e0d expref: 265568 pid: 21343 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.083897:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265558
00010000:00000040:5.0:1550079902.083898:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265557
00010000:00000040:5.0:1550079902.083899:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265565
00000020:00000040:5.0:1550079902.083900:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265567
00000001:00000040:5.0:1550079902.083901:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 68
00010000:00000040:20.0:1550079902.084424:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22391
00000004:00000040:20.0:1550079902.084425:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.084426:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f17ba0d80 with handle 0x6bcd99f6a767d2f0 from hash
00010000:00000040:20.0:1550079902.084428:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22390
00010000:00000040:20.0:1550079902.084428:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22391
00010000:00010000:20.0:1550079902.084430:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f17ba0d80/0x6bcd99f6a767d2f0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22391 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b0ffbd expref: 22391 pid: 21329 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.084433:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22390
00010000:00000040:20.0:1550079902.084434:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22389
00010000:00000040:20.0:1550079902.084434:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22389
00000020:00000040:20.0:1550079902.084435:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22390
00000001:00000040:20.0:1550079902.084436:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 53
00010000:00000040:5.0:1550079902.084653:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265558
00000004:00000040:5.0:1550079902.084653:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.084654:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265559
00010000:00010000:5.0:1550079902.084656:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e624af40/0x6bcd99f6a80b6b33 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265559 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff105e0d expref: 265567 pid: 21758 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.084659:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265558
00000020:00000040:5.0:1550079902.084661:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e624af40 with handle 0x6bcd99f6a80b6b33 from hash
00010000:00000040:5.0:1550079902.084662:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265557
00010000:00000040:5.0:1550079902.084663:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265558
00010000:00010000:5.0:1550079902.084664:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e624af40/0x6bcd99f6a80b6b33 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265558 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff105e0d expref: 265567 pid: 21758 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.084667:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265557
00010000:00000040:5.0:1550079902.084668:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265556
00010000:00000040:5.0:1550079902.084668:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265564
00000020:00000040:5.0:1550079902.084669:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265566
00000001:00000040:5.0:1550079902.084670:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 69
00010000:00000040:20.0:1550079902.085400:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22390
00000004:00000040:20.0:1550079902.085401:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.085403:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4466c1f80 with handle 0x6bcd99f6a74010e2 from hash
00010000:00000040:20.0:1550079902.085404:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22389
00010000:00000040:20.0:1550079902.085405:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22390
00010000:00010000:20.0:1550079902.085406:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4466c1f80/0x6bcd99f6a74010e2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22390 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a9ffbd expref: 22390 pid: 21888 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.085413:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22389
00010000:00000040:20.0:1550079902.085414:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22388
00010000:00000040:20.0:1550079902.085415:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22388
00000020:00000040:20.0:1550079902.085415:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22389
00000001:00000040:20.0:1550079902.085416:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 54
00010000:00000040:5.0:1550079902.085426:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265557
00000004:00000040:5.0:1550079902.085427:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.085428:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265558
00010000:00010000:5.0:1550079902.085429:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca4529f6540/0x6bcd99f6a7f327e7 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265558 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff095e0d expref: 265566 pid: 21346 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.085433:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265557
00000020:00000040:5.0:1550079902.085435:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca4529f6540 with handle 0x6bcd99f6a7f327e7 from hash
00010000:00000040:5.0:1550079902.085436:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265556
00010000:00000040:5.0:1550079902.085437:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265557
00010000:00010000:5.0:1550079902.085438:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca4529f6540/0x6bcd99f6a7f327e7 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265557 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff095e0d expref: 265566 pid: 21346 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.085441:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265556
00010000:00000040:5.0:1550079902.085442:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265555
00010000:00000040:5.0:1550079902.085442:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265563
00000020:00000040:5.0:1550079902.085443:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265565
00000001:00000040:5.0:1550079902.085444:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 70
00010000:00000040:5.0:1550079902.086200:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265556
00000004:00000040:5.0:1550079902.086201:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.086202:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265557
00010000:00010000:5.0:1550079902.086203:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc42b1dad00/0x6bcd99f6a7c61031 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265557 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff025e0d expref: 265565 pid: 20581 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.086206:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265556
00000020:00000040:5.0:1550079902.086207:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc42b1dad00 with handle 0x6bcd99f6a7c61031 from hash
00010000:00000040:5.0:1550079902.086208:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265555
00010000:00000040:5.0:1550079902.086209:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265556
00010000:00010000:5.0:1550079902.086210:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc42b1dad00/0x6bcd99f6a7c61031 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265556 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff025e0d expref: 265565 pid: 20581 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.086213:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265555
00010000:00000040:5.0:1550079902.086214:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265554
00010000:00000040:5.0:1550079902.086214:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265562
00000020:00000040:5.0:1550079902.086215:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265564
00000001:00000040:5.0:1550079902.086217:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 71
00010000:00000040:20.0:1550079902.086381:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22389
00000004:00000040:20.0:1550079902.086382:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.086383:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9fe762e300 with handle 0x6bcd99f6a709cdd2 from hash
00010000:00000040:20.0:1550079902.086384:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22388
00010000:00000040:20.0:1550079902.086385:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22389
00010000:00010000:20.0:1550079902.086387:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9fe762e300/0x6bcd99f6a709cdd2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22389 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a2ffbd expref: 22389 pid: 21336 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.086390:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22388
00010000:00000040:20.0:1550079902.086391:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22387
00010000:00000040:20.0:1550079902.086391:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22387
00000020:00000040:20.0:1550079902.086392:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22388
00000001:00000040:20.0:1550079902.086393:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 55
00010000:00000040:5.0:1550079902.086968:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265555
00000004:00000040:5.0:1550079902.086969:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.086970:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265556
00010000:00010000:5.0:1550079902.086972:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca40a3a5e80/0x6bcd99f6a7931942 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265556 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefb5e0d expref: 265564 pid: 21823 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.086975:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265555
00000020:00000040:5.0:1550079902.086977:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca40a3a5e80 with handle 0x6bcd99f6a7931942 from hash
00010000:00000040:5.0:1550079902.086978:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265554
00010000:00000040:5.0:1550079902.086978:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265555
00010000:00010000:5.0:1550079902.086980:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca40a3a5e80/0x6bcd99f6a7931942 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265555 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefb5e0d expref: 265564 pid: 21823 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.086983:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265554
00010000:00000040:5.0:1550079902.086983:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265553
00010000:00000040:5.0:1550079902.086984:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265561
00000020:00000040:5.0:1550079902.086985:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265563
00000001:00000040:5.0:1550079902.086986:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 72
00010000:00000040:20.0:1550079902.087358:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22388
00000004:00000040:20.0:1550079902.087359:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.087361:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc44105f740 with handle 0x6bcd99f6a9786860 from hash
00010000:00000040:20.0:1550079902.087362:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22387
00010000:00000040:20.0:1550079902.087363:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22388
00010000:00010000:20.0:1550079902.087364:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc44105f740/0x6bcd99f6a9786860 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22388 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ea07be expref: 22388 pid: 21752 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.087368:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22387
00010000:00000040:20.0:1550079902.087368:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22386
00010000:00000040:20.0:1550079902.087370:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22386
00000020:00000040:20.0:1550079902.087371:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22387
00000001:00000040:20.0:1550079902.087372:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 56
00010000:00000040:5.0:1550079902.087738:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265554
00000004:00000040:5.0:1550079902.087739:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.087740:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265555
00010000:00010000:5.0:1550079902.087741:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd484bfd580/0x6bcd99f6a76eeb2a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265555 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef45e0d expref: 265563 pid: 21840 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.087745:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265554
00000020:00000040:5.0:1550079902.087746:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd484bfd580 with handle 0x6bcd99f6a76eeb2a from hash
00010000:00000040:5.0:1550079902.087747:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265553
00010000:00000040:5.0:1550079902.087748:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265554
00010000:00010000:5.0:1550079902.087750:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd484bfd580/0x6bcd99f6a76eeb2a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265554 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef45e0d expref: 265563 pid: 21840 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.087753:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265553
00010000:00000040:5.0:1550079902.087754:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265552
00010000:00000040:5.0:1550079902.087754:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265560
00000020:00000040:5.0:1550079902.087755:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265562
00000001:00000040:5.0:1550079902.087756:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 73
00010000:00000040:20.0:1550079902.088337:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22387
00000004:00000040:20.0:1550079902.088337:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.088339:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e43c99f80 with handle 0x6bcd99f6a9226298 from hash
00010000:00000040:20.0:1550079902.088340:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22386
00010000:00000040:20.0:1550079902.088341:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22387
00010000:00010000:20.0:1550079902.088342:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e43c99f80/0x6bcd99f6a9226298 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22387 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e307be expref: 22387 pid: 21840 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.088346:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22386
00010000:00000040:20.0:1550079902.088346:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22385
00010000:00000040:20.0:1550079902.088347:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22385
00000020:00000040:20.0:1550079902.088348:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22386
00000001:00000040:20.0:1550079902.088349:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 57
00010000:00000040:5.0:1550079902.088512:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265553
00000004:00000040:5.0:1550079902.088513:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.088514:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265554
00010000:00010000:5.0:1550079902.088515:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f94e3180/0x6bcd99f6a747fcf1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265554 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feed5e0d expref: 265562 pid: 21888 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.088519:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265553
00000020:00000040:5.0:1550079902.088520:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3f94e3180 with handle 0x6bcd99f6a747fcf1 from hash
00010000:00000040:5.0:1550079902.088521:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265552
00010000:00000040:5.0:1550079902.088522:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265553
00010000:00010000:5.0:1550079902.088523:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f94e3180/0x6bcd99f6a747fcf1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265553 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feed5e0d expref: 265562 pid: 21888 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.088526:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265552
00010000:00000040:5.0:1550079902.088527:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265551
00010000:00000040:5.0:1550079902.088528:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265559
00000020:00000040:5.0:1550079902.088528:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265561
00000001:00000040:5.0:1550079902.088529:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 74
00010000:00000040:5.0:1550079902.089286:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265552
00000004:00000040:5.0:1550079902.089286:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.089287:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265553
00010000:00010000:5.0:1550079902.089288:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e7bb0e540/0x6bcd99f6a71e8cbe lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265553 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee65e0d expref: 265561 pid: 21816 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.089292:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265552
00000020:00000040:5.0:1550079902.089293:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e7bb0e540 with handle 0x6bcd99f6a71e8cbe from hash
00010000:00000040:5.0:1550079902.089294:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265551
00010000:00000040:5.0:1550079902.089295:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265552
00010000:00010000:5.0:1550079902.089296:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e7bb0e540/0x6bcd99f6a71e8cbe lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265552 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee65e0d expref: 265561 pid: 21816 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.089299:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265551
00010000:00000040:5.0:1550079902.089300:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265550
00010000:00000040:5.0:1550079902.089300:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265558
00000020:00000040:5.0:1550079902.089301:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265560
00000001:00000040:5.0:1550079902.089302:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 75
00010000:00000040:20.0:1550079902.089313:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22386
00000004:00000040:20.0:1550079902.089314:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.089316:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc402105e80 with handle 0x6bcd99f6a8ed0172 from hash
00010000:00000040:20.0:1550079902.089317:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22385
00010000:00000040:20.0:1550079902.089318:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22386
00010000:00010000:20.0:1550079902.089319:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc402105e80/0x6bcd99f6a8ed0172 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22386 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52dc07be expref: 22386 pid: 21457 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.089322:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22385
00010000:00000040:20.0:1550079902.089323:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22384
00010000:00000040:20.0:1550079902.089324:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22384
00000020:00000040:20.0:1550079902.089325:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22385
00000001:00000040:20.0:1550079902.089326:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 58
00010000:00000040:5.0:1550079902.090054:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265551
00000004:00000040:5.0:1550079902.090055:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.090056:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265552
00010000:00010000:5.0:1550079902.090057:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb415d318c0/0x6bcd99f6a6fcffe1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265552 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedf5e0d expref: 265560 pid: 21324 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.090061:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265551
00000020:00000040:5.0:1550079902.090062:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb415d318c0 with handle 0x6bcd99f6a6fcffe1 from hash
00010000:00000040:5.0:1550079902.090063:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265550
00010000:00000040:5.0:1550079902.090064:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265551
00010000:00010000:5.0:1550079902.090065:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb415d318c0/0x6bcd99f6a6fcffe1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265551 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedf5e0d expref: 265560 pid: 21324 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.090068:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265550
00010000:00000040:5.0:1550079902.090069:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265549
00010000:00000040:5.0:1550079902.090070:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265557
00000020:00000040:5.0:1550079902.090071:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265559
00000001:00000040:5.0:1550079902.090072:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 76
00010000:00000040:20.0:1550079902.090291:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22385
00000004:00000040:20.0:1550079902.090292:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.090294:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4078106c0 with handle 0x6bcd99f6a8a52f04 from hash
00010000:00000040:20.0:1550079902.090295:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22384
00010000:00000040:20.0:1550079902.090296:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22385
00010000:00010000:20.0:1550079902.090297:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4078106c0/0x6bcd99f6a8a52f04 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22385 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d507be expref: 22385 pid: 21859 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.090300:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22384
00010000:00000040:20.0:1550079902.090301:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22383
00010000:00000040:20.0:1550079902.090302:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22383
00000020:00000040:20.0:1550079902.090302:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22384
00000001:00000040:20.0:1550079902.090303:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 59
00010000:00000040:5.0:1550079902.090824:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265550
00000004:00000040:5.0:1550079902.090825:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.090826:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265551
00010000:00010000:5.0:1550079902.090828:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd481c6aac0/0x6bcd99f6a6d2c82e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265551 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed85e0d expref: 265559 pid: 21800 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.090831:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265550
00000020:00000040:5.0:1550079902.090833:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd481c6aac0 with handle 0x6bcd99f6a6d2c82e from hash
00010000:00000040:5.0:1550079902.090834:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265549
00010000:00000040:5.0:1550079902.090835:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265550
00010000:00010000:5.0:1550079902.090836:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd481c6aac0/0x6bcd99f6a6d2c82e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265550 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed85e0d expref: 265559 pid: 21800 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.090839:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265549
00010000:00000040:5.0:1550079902.090840:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265548
00010000:00000040:5.0:1550079902.090840:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265556
00000020:00000040:5.0:1550079902.090841:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265558
00000001:00000040:5.0:1550079902.090842:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 77
00010000:00000040:20.0:1550079902.091268:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22384
00000004:00000040:20.0:1550079902.091269:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.091270:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc2aab60240 with handle 0x6bcd99f6a8689a45 from hash
00010000:00000040:20.0:1550079902.091271:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22383
00010000:00000040:20.0:1550079902.091272:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22384
00010000:00010000:20.0:1550079902.091274:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc2aab60240/0x6bcd99f6a8689a45 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22384 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ce07be expref: 22384 pid: 21727 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.091277:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22383
00010000:00000040:20.0:1550079902.091278:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22382
00010000:00000040:20.0:1550079902.091279:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22382
00000020:00000040:20.0:1550079902.091279:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22383
00000001:00000040:20.0:1550079902.091280:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 60
00010000:00000040:5.0:1550079902.091599:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265549
00000004:00000040:5.0:1550079902.091600:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.091600:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265550
00010000:00010000:5.0:1550079902.091602:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3dc144ec0/0x6bcd99f6a6b119af lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265550 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed15e0d expref: 265558 pid: 21324 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.091605:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265549
00000020:00000040:5.0:1550079902.091607:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3dc144ec0 with handle 0x6bcd99f6a6b119af from hash
00010000:00000040:5.0:1550079902.091608:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265548
00010000:00000040:5.0:1550079902.091609:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265549
00010000:00010000:5.0:1550079902.091611:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3dc144ec0/0x6bcd99f6a6b119af lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265549 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed15e0d expref: 265558 pid: 21324 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.091614:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265548
00010000:00000040:5.0:1550079902.091614:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265547
00010000:00000040:5.0:1550079902.091615:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265555
00000020:00000040:5.0:1550079902.091616:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265557
00000001:00000040:5.0:1550079902.091617:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 78
00010000:00000040:20.0:1550079902.092243:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22383
00000004:00000040:20.0:1550079902.092244:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.092246:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc470c40240 with handle 0x6bcd99f6a81f3af2 from hash
00010000:00000040:20.0:1550079902.092247:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22382
00010000:00000040:20.0:1550079902.092248:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22383
00010000:00010000:20.0:1550079902.092250:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc470c40240/0x6bcd99f6a81f3af2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22383 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c707be expref: 22383 pid: 21356 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.092253:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22382
00010000:00000040:20.0:1550079902.092254:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22381
00010000:00000040:20.0:1550079902.092254:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22381
00000020:00000040:20.0:1550079902.092255:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22382
00000001:00000040:20.0:1550079902.092257:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 61
00010000:00000040:5.0:1550079902.092373:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265548
00000004:00000040:5.0:1550079902.092374:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.092375:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265549
00010000:00010000:5.0:1550079902.092376:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4367b6780/0x6bcd99f6a674a8a6 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265549 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feca5e0d expref: 265557 pid: 21858 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.092380:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265548
00000020:00000040:5.0:1550079902.092381:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4367b6780 with handle 0x6bcd99f6a674a8a6 from hash
00010000:00000040:5.0:1550079902.092382:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265547
00010000:00000040:5.0:1550079902.092383:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265548
00010000:00010000:5.0:1550079902.092384:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4367b6780/0x6bcd99f6a674a8a6 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265548 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feca5e0d expref: 265557 pid: 21858 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.092387:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265547
00010000:00000040:5.0:1550079902.092388:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265546
00010000:00000040:5.0:1550079902.092389:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265554
00000020:00000040:5.0:1550079902.092389:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265556
00000001:00000040:5.0:1550079902.092391:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 79
00010000:00000040:5.0:1550079902.093146:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265547
00000004:00000040:5.0:1550079902.093147:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.093148:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265548
00010000:00010000:5.0:1550079902.093149:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd499c65a00/0x6bcd99f6a885a5aa lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265548 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff38660d expref: 265556 pid: 20610 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.093154:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265547
00000020:00000040:5.0:1550079902.093155:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd499c65a00 with handle 0x6bcd99f6a885a5aa from hash
00010000:00000040:5.0:1550079902.093156:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265546
00010000:00000040:5.0:1550079902.093157:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265547
00010000:00010000:5.0:1550079902.093158:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd499c65a00/0x6bcd99f6a885a5aa lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265547 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff38660d expref: 265556 pid: 20610 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.093161:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265546
00010000:00000040:5.0:1550079902.093162:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265545
00010000:00000040:5.0:1550079902.093162:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265553
00000020:00000040:5.0:1550079902.093163:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265555
00000001:00000040:5.0:1550079902.093164:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 80
00010000:00000040:20.0:1550079902.093221:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22382
00000004:00000040:20.0:1550079902.093222:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.093223:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4069a8240 with handle 0x6bcd99f6a7db03ab from hash
00010000:00000040:20.0:1550079902.093225:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22381
00010000:00000040:20.0:1550079902.093225:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22382
00010000:00010000:20.0:1550079902.093227:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4069a8240/0x6bcd99f6a7db03ab lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22382 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c007be expref: 22382 pid: 21888 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.093230:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22381
00010000:00000040:20.0:1550079902.093231:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22380
00010000:00000040:20.0:1550079902.093232:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22380
00000020:00000040:20.0:1550079902.093233:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22381
00000001:00000040:20.0:1550079902.093234:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 62
00010000:00000040:5.0:1550079902.093915:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265546
00000004:00000040:5.0:1550079902.093916:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.093917:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265547
00010000:00010000:5.0:1550079902.093919:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb434341680/0x6bcd99f6a86df0b1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265547 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff31660d expref: 265555 pid: 21739 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.093922:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265546
00000020:00000040:5.0:1550079902.093924:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb434341680 with handle 0x6bcd99f6a86df0b1 from hash
00010000:00000040:5.0:1550079902.093925:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265545
00010000:00000040:5.0:1550079902.093925:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265546
00010000:00010000:5.0:1550079902.093927:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb434341680/0x6bcd99f6a86df0b1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265546 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff31660d expref: 265555 pid: 21739 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.093930:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265545
00010000:00000040:5.0:1550079902.093930:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265544
00010000:00000040:5.0:1550079902.093931:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265552
00000020:00000040:5.0:1550079902.093933:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265554
00000001:00000040:5.0:1550079902.093934:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 81
00010000:00000040:20.0:1550079902.094198:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22381
00000004:00000040:20.0:1550079902.094199:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.094201:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3ee088900 with handle 0x6bcd99f6a7a3be74 from hash
00010000:00000040:20.0:1550079902.094202:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22380
00010000:00000040:20.0:1550079902.094203:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22381
00010000:00010000:20.0:1550079902.094205:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3ee088900/0x6bcd99f6a7a3be74 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22381 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b907be expref: 22381 pid: 21794 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.094208:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22380
00010000:00000040:20.0:1550079902.094209:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22379
00010000:00000040:20.0:1550079902.094210:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22379
00000020:00000040:20.0:1550079902.094210:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22380
00000001:00000040:20.0:1550079902.094211:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 63
00010000:00000040:5.0:1550079902.094686:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265545
00000004:00000040:5.0:1550079902.094686:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.094687:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265546
00010000:00010000:5.0:1550079902.094689:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4b2de1200/0x6bcd99f6a857a397 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265546 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2a660d expref: 265554 pid: 20644 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.094692:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265545
00000020:00000040:5.0:1550079902.094694:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4b2de1200 with handle 0x6bcd99f6a857a397 from hash
00010000:00000040:5.0:1550079902.094695:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265544
00010000:00000040:5.0:1550079902.094696:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265545
00010000:00010000:5.0:1550079902.094697:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4b2de1200/0x6bcd99f6a857a397 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265545 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2a660d expref: 265554 pid: 20644 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.094700:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265544
00010000:00000040:5.0:1550079902.094701:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265543
00010000:00000040:5.0:1550079902.094702:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265551
00000020:00000040:5.0:1550079902.094702:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265553
00000001:00000040:5.0:1550079902.094703:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 82
00010000:00000040:20.0:1550079902.095177:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22380
00000004:00000040:20.0:1550079902.095178:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.095180:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb46ec13840 with handle 0x6bcd99f6a76e0e41 from hash
00010000:00000040:20.0:1550079902.095181:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22379
00010000:00000040:20.0:1550079902.095182:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22380
00010000:00010000:20.0:1550079902.095184:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb46ec13840/0x6bcd99f6a76e0e41 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22380 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b207be expref: 22380 pid: 21739 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.095187:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22379
00010000:00000040:20.0:1550079902.095187:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22378
00010000:00000040:20.0:1550079902.095188:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22378
00000020:00000040:20.0:1550079902.095189:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22379
00000001:00000040:20.0:1550079902.095190:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 64
00010000:00000040:5.0:1550079902.095460:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265544
00000004:00000040:5.0:1550079902.095461:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.095462:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265545
00010000:00010000:5.0:1550079902.095463:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd45a2ff500/0x6bcd99f6a841bb01 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265545 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff23660d expref: 265553 pid: 20793 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.095467:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265544
00000020:00000040:5.0:1550079902.095468:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45a2ff500 with handle 0x6bcd99f6a841bb01 from hash
00010000:00000040:5.0:1550079902.095469:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265543
00010000:00000040:5.0:1550079902.095470:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265544
00010000:00010000:5.0:1550079902.095472:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45a2ff500/0x6bcd99f6a841bb01 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265544 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff23660d expref: 265553 pid: 20793 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.095475:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265543
00010000:00000040:5.0:1550079902.095476:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265542
00010000:00000040:5.0:1550079902.095477:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265550
00000020:00000040:5.0:1550079902.095477:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265552
00000001:00000040:5.0:1550079902.095479:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 83
00010000:00000040:20.0:1550079902.096155:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22379
00000004:00000040:20.0:1550079902.096156:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.096157:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d9bafd340 with handle 0x6bcd99f6a7491403 from hash
00010000:00000040:20.0:1550079902.096159:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22378
00010000:00000040:20.0:1550079902.096159:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22379
00010000:00010000:20.0:1550079902.096161:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9bafd340/0x6bcd99f6a7491403 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22379 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ab07be expref: 22379 pid: 20532 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.096164:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22378
00010000:00000040:20.0:1550079902.096165:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22377
00010000:00000040:20.0:1550079902.096165:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22377
00000020:00000040:20.0:1550079902.096166:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22378
00000001:00000040:20.0:1550079902.096167:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 65
00010000:00000040:5.0:1550079902.096235:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265543
00000004:00000040:5.0:1550079902.096235:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.096236:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265544
00010000:00010000:5.0:1550079902.096238:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd49376ba80/0x6bcd99f6a82ee367 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265544 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1c660d expref: 265552 pid: 21271 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.096241:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265543
00000020:00000040:5.0:1550079902.096243:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd49376ba80 with handle 0x6bcd99f6a82ee367 from hash
00010000:00000040:5.0:1550079902.096244:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265542
00010000:00000040:5.0:1550079902.096245:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265543
00010000:00010000:5.0:1550079902.096246:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd49376ba80/0x6bcd99f6a82ee367 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265543 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1c660d expref: 265552 pid: 21271 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.096249:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265542
00010000:00000040:5.0:1550079902.096249:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265541
00010000:00000040:5.0:1550079902.096250:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265549
00000020:00000040:5.0:1550079902.096251:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265551
00000001:00000040:5.0:1550079902.096252:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 84
00010000:00000040:5.0:1550079902.097009:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265542
00000004:00000040:5.0:1550079902.097009:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.097010:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265543
00010000:00010000:5.0:1550079902.097011:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3eca8cc80/0x6bcd99f6a81d0407 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265543 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff15660d expref: 265551 pid: 21853 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.097015:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265542
00000020:00000040:5.0:1550079902.097017:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3eca8cc80 with handle 0x6bcd99f6a81d0407 from hash
00010000:00000040:5.0:1550079902.097018:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265541
00010000:00000040:5.0:1550079902.097018:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265542
00010000:00010000:5.0:1550079902.097019:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3eca8cc80/0x6bcd99f6a81d0407 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265542 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff15660d expref: 265551 pid: 21853 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.097022:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265541
00010000:00000040:5.0:1550079902.097023:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265540
00010000:00000040:5.0:1550079902.097024:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265548
00000020:00000040:5.0:1550079902.097024:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265550
00000001:00000040:5.0:1550079902.097025:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 85
00010000:00000040:20.0:1550079902.097133:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22378
00000004:00000040:20.0:1550079902.097134:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.097135:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3fabd5340 with handle 0x6bcd99f6a7114ca4 from hash
00010000:00000040:20.0:1550079902.097136:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22377
00010000:00000040:20.0:1550079902.097137:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22378
00010000:00010000:20.0:1550079902.097139:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fabd5340/0x6bcd99f6a7114ca4 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22378 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a407be expref: 22378 pid: 20532 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.097142:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22377
00010000:00000040:20.0:1550079902.097143:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22376
00010000:00000040:20.0:1550079902.097143:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22376
00000020:00000040:20.0:1550079902.097144:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22377
00000001:00000040:20.0:1550079902.097145:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 66
00010000:00000040:5.0:1550079902.097773:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265541
00000004:00000040:5.0:1550079902.097774:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.097774:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265542
00010000:00010000:5.0:1550079902.097776:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e28511200/0x6bcd99f6a8083562 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265542 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0e660d expref: 265550 pid: 21845 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.097779:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265541
00000020:00000040:5.0:1550079902.097781:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e28511200 with handle 0x6bcd99f6a8083562 from hash
00010000:00000040:5.0:1550079902.097782:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265540
00010000:00000040:5.0:1550079902.097782:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265541
00010000:00010000:5.0:1550079902.097784:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e28511200/0x6bcd99f6a8083562 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265541 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0e660d expref: 265550 pid: 21845 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.097787:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265540
00010000:00000040:5.0:1550079902.097787:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265539
00010000:00000040:5.0:1550079902.097788:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265547
00000020:00000040:5.0:1550079902.097789:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265549
00000001:00000040:5.0:1550079902.097790:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 86
00010000:00000040:20.0:1550079902.098110:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22377
00000004:00000040:20.0:1550079902.098111:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.098113:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc484773600 with handle 0x6bcd99f6a95e539b from hash
00010000:00000040:20.0:1550079902.098114:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22376
00010000:00000040:20.0:1550079902.098115:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22377
00010000:00010000:20.0:1550079902.098117:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc484773600/0x6bcd99f6a95e539b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22377 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e80fbe expref: 22377 pid: 21838 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.098120:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22376
00010000:00000040:20.0:1550079902.098120:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22375
00010000:00000040:20.0:1550079902.098121:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22375
00000020:00000040:20.0:1550079902.098122:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22376
00000001:00000040:20.0:1550079902.098123:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 67
00010000:00000040:5.0:1550079902.098547:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265540
00000004:00000040:5.0:1550079902.098547:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.098548:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265541
00010000:00010000:5.0:1550079902.098550:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46b5c7bc0/0x6bcd99f6a7e8fcab lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265541 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff07660d expref: 265549 pid: 20610 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.098554:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265540
00000020:00000040:5.0:1550079902.098555:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46b5c7bc0 with handle 0x6bcd99f6a7e8fcab from hash
00010000:00000040:5.0:1550079902.098556:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265539
00010000:00000040:5.0:1550079902.098557:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265540
00010000:00010000:5.0:1550079902.098558:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46b5c7bc0/0x6bcd99f6a7e8fcab lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265540 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff07660d expref: 265549 pid: 20610 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.098561:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265539
00010000:00000040:5.0:1550079902.098562:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265538
00010000:00000040:5.0:1550079902.098563:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265546
00000020:00000040:5.0:1550079902.098564:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265548
00000001:00000040:5.0:1550079902.098565:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 87
00010000:00000040:20.0:1550079902.099088:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22376
00000004:00000040:20.0:1550079902.099089:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.099091:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc41fb8d580 with handle 0x6bcd99f6a90d9096 from hash
00010000:00000040:20.0:1550079902.099092:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22375
00010000:00000040:20.0:1550079902.099093:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22376
00010000:00010000:20.0:1550079902.099095:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc41fb8d580/0x6bcd99f6a90d9096 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22376 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e10fbe expref: 22376 pid: 21356 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.099098:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22375
00010000:00000040:20.0:1550079902.099099:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22374
00010000:00000040:20.0:1550079902.099100:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22374
00000020:00000040:20.0:1550079902.099100:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22375
00000001:00000040:20.0:1550079902.099101:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 68
00010000:00000040:5.0:1550079902.099322:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265539
00000004:00000040:5.0:1550079902.099323:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.099324:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265540
00010000:00010000:5.0:1550079902.099325:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9df5f3a400/0x6bcd99f6a7b87882 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265540 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff00660d expref: 265548 pid: 21067 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.099328:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265539
00000020:00000040:5.0:1550079902.099330:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9df5f3a400 with handle 0x6bcd99f6a7b87882 from hash
00010000:00000040:5.0:1550079902.099331:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265538
00010000:00000040:5.0:1550079902.099332:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265539
00010000:00010000:5.0:1550079902.099333:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9df5f3a400/0x6bcd99f6a7b87882 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265539 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff00660d expref: 265548 pid: 21067 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.099337:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265538
00010000:00000040:5.0:1550079902.099337:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265537
00010000:00000040:5.0:1550079902.099338:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265545
00000020:00000040:5.0:1550079902.099339:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265547
00000001:00000040:5.0:1550079902.099340:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 88
00010000:00000040:20.0:1550079902.100066:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22375
00000004:00000040:20.0:1550079902.100067:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.100068:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f85eef980 with handle 0x6bcd99f6a8d731c5 from hash
00010000:00000040:20.0:1550079902.100070:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22374
00010000:00000040:20.0:1550079902.100071:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22375
00010000:00010000:20.0:1550079902.100072:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f85eef980/0x6bcd99f6a8d731c5 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22375 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52da0fbe expref: 22375 pid: 20612 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.100075:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22374
00010000:00000040:20.0:1550079902.100076:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22373
00010000:00000040:20.0:1550079902.100077:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22373
00000020:00000040:20.0:1550079902.100077:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22374
00000001:00000040:20.0:1550079902.100078:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 69
00010000:00000040:5.0:1550079902.100096:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265538
00000004:00000040:5.0:1550079902.100097:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.100097:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265539
00010000:00010000:5.0:1550079902.100099:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc396a4b840/0x6bcd99f6a78b0268 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265539 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef9660d expref: 265547 pid: 21644 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.100103:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265538
00000020:00000040:5.0:1550079902.100104:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc396a4b840 with handle 0x6bcd99f6a78b0268 from hash
00010000:00000040:5.0:1550079902.100105:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265537
00010000:00000040:5.0:1550079902.100106:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265538
00010000:00010000:5.0:1550079902.100107:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc396a4b840/0x6bcd99f6a78b0268 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265538 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef9660d expref: 265547 pid: 21644 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.100110:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265537
00010000:00000040:5.0:1550079902.100111:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265536
00010000:00000040:5.0:1550079902.100112:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265544
00000020:00000040:5.0:1550079902.100112:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265546
00000001:00000040:5.0:1550079902.100113:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 89
00010000:00000040:5.0:1550079902.100869:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265537
00000004:00000040:5.0:1550079902.100870:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.100871:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265538
00010000:00010000:5.0:1550079902.100872:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca3a40ae0c0/0x6bcd99f6a75eb431 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265538 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef2660d expref: 265546 pid: 21845 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.100876:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265537
00000020:00000040:5.0:1550079902.100877:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3a40ae0c0 with handle 0x6bcd99f6a75eb431 from hash
00010000:00000040:5.0:1550079902.100878:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265536
00010000:00000040:5.0:1550079902.100879:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265537
00010000:00010000:5.0:1550079902.100880:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3a40ae0c0/0x6bcd99f6a75eb431 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265537 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef2660d expref: 265546 pid: 21845 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.100883:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265536
00010000:00000040:5.0:1550079902.100884:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265535
00010000:00000040:5.0:1550079902.100884:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265543
00000020:00000040:5.0:1550079902.100885:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265545
00000001:00000040:5.0:1550079902.100886:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 90
00010000:00000040:20.0:1550079902.101043:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22374
00000004:00000040:20.0:1550079902.101044:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.101046:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3b48d7500 with handle 0x6bcd99f6a8950df2 from hash
00010000:00000040:20.0:1550079902.101047:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22373
00010000:00000040:20.0:1550079902.101048:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22374
00010000:00010000:20.0:1550079902.101050:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3b48d7500/0x6bcd99f6a8950df2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22374 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d30fbe expref: 22374 pid: 21884 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.101056:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22373
00010000:00000040:20.0:1550079902.101057:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22372
00010000:00000040:20.0:1550079902.101058:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22372
00000020:00000040:20.0:1550079902.101059:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22373
00000001:00000040:20.0:1550079902.101060:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 70
00010000:00000040:5.0:1550079902.101634:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265536
00000004:00000040:5.0:1550079902.101635:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.101635:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265537
00010000:00010000:5.0:1550079902.101637:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb43e30bcc0/0x6bcd99f6a741e509 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265537 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feeb660d expref: 265545 pid: 21830 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.101640:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265536
00000020:00000040:5.0:1550079902.101642:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb43e30bcc0 with handle 0x6bcd99f6a741e509 from hash
00010000:00000040:5.0:1550079902.101643:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265535
00010000:00000040:5.0:1550079902.101643:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265536
00010000:00010000:5.0:1550079902.101645:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb43e30bcc0/0x6bcd99f6a741e509 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265536 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feeb660d expref: 265545 pid: 21830 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.101648:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265535
00010000:00000040:5.0:1550079902.101648:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265534
00010000:00000040:5.0:1550079902.101649:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265542
00000020:00000040:5.0:1550079902.101651:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265544
00000001:00000040:5.0:1550079902.101652:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 91
00010000:00000040:20.0:1550079902.102024:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22373
00000004:00000040:20.0:1550079902.102025:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.102027:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48469dc40 with handle 0x6bcd99f6a84d9a7b from hash
00010000:00000040:20.0:1550079902.102028:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22372
00010000:00000040:20.0:1550079902.102029:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22373
00010000:00010000:20.0:1550079902.102030:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48469dc40/0x6bcd99f6a84d9a7b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22373 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cc0fbe expref: 22373 pid: 21248 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.102033:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22372
00010000:00000040:20.0:1550079902.102034:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22371
00010000:00000040:20.0:1550079902.102035:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22371
00000020:00000040:20.0:1550079902.102035:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22372
00000001:00000040:20.0:1550079902.102037:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 71
00010000:00000040:5.0:1550079902.102408:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265535
00000004:00000040:5.0:1550079902.102409:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.102410:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265536
00010000:00010000:5.0:1550079902.102412:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb429fe3180/0x6bcd99f6a713ad18 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265536 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee4660d expref: 265544 pid: 21456 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.102415:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265535
00000020:00000040:5.0:1550079902.102417:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb429fe3180 with handle 0x6bcd99f6a713ad18 from hash
00010000:00000040:5.0:1550079902.102418:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265534
00010000:00000040:5.0:1550079902.102419:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265535
00010000:00010000:5.0:1550079902.102420:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb429fe3180/0x6bcd99f6a713ad18 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265535 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee4660d expref: 265544 pid: 21456 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.102423:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265534
00010000:00000040:5.0:1550079902.102424:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265533
00010000:00000040:5.0:1550079902.102424:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265541
00000020:00000040:5.0:1550079902.102425:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265543
00000001:00000040:5.0:1550079902.102426:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 92
00010000:00000040:20.0:1550079902.102999:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22372
00000004:00000040:20.0:1550079902.103000:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.103002:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd494b25c40 with handle 0x6bcd99f6a815091f from hash
00010000:00000040:20.0:1550079902.103003:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22371
00010000:00000040:20.0:1550079902.103004:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22372
00010000:00010000:20.0:1550079902.103005:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd494b25c40/0x6bcd99f6a815091f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22372 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c50fbe expref: 22372 pid: 21745 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.103009:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22371
00010000:00000040:20.0:1550079902.103009:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22370
00010000:00000040:20.0:1550079902.103011:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22370
00000020:00000040:20.0:1550079902.103011:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22371
00000001:00000040:20.0:1550079902.103013:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 72
00010000:00000040:5.0:1550079902.103182:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265534
00000004:00000040:5.0:1550079902.103183:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.103184:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265535
00010000:00010000:5.0:1550079902.103186:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3ebbbcec0/0x6bcd99f6a6f13789 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265535 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedd660d expref: 265543 pid: 21581 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.103189:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265534
00000020:00000040:5.0:1550079902.103191:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3ebbbcec0 with handle 0x6bcd99f6a6f13789 from hash
00010000:00000040:5.0:1550079902.103192:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265533
00010000:00000040:5.0:1550079902.103192:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265534
00010000:00010000:5.0:1550079902.103194:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3ebbbcec0/0x6bcd99f6a6f13789 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265534 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedd660d expref: 265543 pid: 21581 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.103197:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265533
00010000:00000040:5.0:1550079902.103198:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265532
00010000:00000040:5.0:1550079902.103199:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265540
00000020:00000040:5.0:1550079902.103199:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265542
00000001:00000040:5.0:1550079902.103201:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 93
00010000:00000040:5.0:1550079902.103957:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265533
00000004:00000040:5.0:1550079902.103957:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.103958:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265534
00010000:00010000:5.0:1550079902.103960:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4263bc140/0x6bcd99f6a6c58287 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265534 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed6660d expref: 265542 pid: 21849 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.103963:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265533
00000020:00000040:5.0:1550079902.103964:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4263bc140 with handle 0x6bcd99f6a6c58287 from hash
00010000:00000040:5.0:1550079902.103965:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265532
00010000:00000040:5.0:1550079902.103966:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265533
00010000:00010000:5.0:1550079902.103967:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4263bc140/0x6bcd99f6a6c58287 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265533 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed6660d expref: 265542 pid: 21849 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.103970:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265532
00010000:00000040:5.0:1550079902.103971:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265531
00010000:00000040:5.0:1550079902.103971:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265539
00000020:00000040:5.0:1550079902.103972:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265541
00000001:00000040:5.0:1550079902.103973:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 94
00010000:00000040:20.0:1550079902.103976:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22371
00000004:00000040:20.0:1550079902.103976:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.103978:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc441f17bc0 with handle 0x6bcd99f6a7c4f79e from hash
00010000:00000040:20.0:1550079902.103979:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22370
00010000:00000040:20.0:1550079902.103980:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22371
00010000:00010000:20.0:1550079902.103982:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc441f17bc0/0x6bcd99f6a7c4f79e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22371 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52be0fbe expref: 22371 pid: 21758 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.103985:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22370
00010000:00000040:20.0:1550079902.103986:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22369
00010000:00000040:20.0:1550079902.103986:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22369
00000020:00000040:20.0:1550079902.103987:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22370
00000001:00000040:20.0:1550079902.103988:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 73
00010000:00000040:5.0:1550079902.104721:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265532
00000004:00000040:5.0:1550079902.104722:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.104723:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265533
00010000:00010000:5.0:1550079902.104724:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca405dda1c0/0x6bcd99f6a6a22a90 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265533 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecf660d expref: 265541 pid: 21840 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.104728:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265532
00000020:00000040:5.0:1550079902.104730:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca405dda1c0 with handle 0x6bcd99f6a6a22a90 from hash
00010000:00000040:5.0:1550079902.104730:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265531
00010000:00000040:5.0:1550079902.104731:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265532
00010000:00010000:5.0:1550079902.104732:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca405dda1c0/0x6bcd99f6a6a22a90 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265532 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecf660d expref: 265541 pid: 21840 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.104736:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265531
00010000:00000040:5.0:1550079902.104736:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265530
00010000:00000040:5.0:1550079902.104737:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265538
00000020:00000040:5.0:1550079902.104738:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265540
00000001:00000040:5.0:1550079902.104739:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 95
00010000:00000040:20.0:1550079902.104953:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22370
00000004:00000040:20.0:1550079902.104954:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.104956:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46bbb4140 with handle 0x6bcd99f6a79b0f06 from hash
00010000:00000040:20.0:1550079902.104957:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22369
00010000:00000040:20.0:1550079902.104958:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22370
00010000:00010000:20.0:1550079902.104960:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46bbb4140/0x6bcd99f6a79b0f06 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22370 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b70fbe expref: 22370 pid: 21644 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.104963:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22369
00010000:00000040:20.0:1550079902.104964:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22368
00010000:00000040:20.0:1550079902.104965:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22368
00000020:00000040:20.0:1550079902.104966:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22369
00000001:00000040:20.0:1550079902.104967:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 74
00010000:00000040:5.0:1550079902.105495:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265531
00000004:00000040:5.0:1550079902.105495:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.105496:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265532
00010000:00010000:5.0:1550079902.105498:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb464842f40/0x6bcd99f6a89d7d5d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265532 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3d6e0d expref: 265540 pid: 21884 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.105501:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265531
00000020:00000040:5.0:1550079902.105503:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb464842f40 with handle 0x6bcd99f6a89d7d5d from hash
00010000:00000040:5.0:1550079902.105504:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265530
00010000:00000040:5.0:1550079902.105505:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265531
00010000:00010000:5.0:1550079902.105506:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb464842f40/0x6bcd99f6a89d7d5d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265531 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3d6e0d expref: 265540 pid: 21884 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.105509:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265530
00010000:00000040:5.0:1550079902.105510:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265529
00010000:00000040:5.0:1550079902.105510:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265537
00000020:00000040:5.0:1550079902.105512:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265539
00000001:00000040:5.0:1550079902.105513:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 96
00010000:00000040:20.0:1550079902.105931:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22369
00000004:00000040:20.0:1550079902.105932:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.105934:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46a490b40 with handle 0x6bcd99f6a75f1711 from hash
00010000:00000040:20.0:1550079902.105935:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22368
00010000:00000040:20.0:1550079902.105936:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22369
00010000:00010000:20.0:1550079902.105937:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46a490b40/0x6bcd99f6a75f1711 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22369 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b00fbe expref: 22369 pid: 20535 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.105941:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22368
00010000:00000040:20.0:1550079902.105941:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22367
00010000:00000040:20.0:1550079902.105942:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22367
00000020:00000040:20.0:1550079902.105943:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22368
00000001:00000040:20.0:1550079902.105944:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 75
00010000:00000040:5.0:1550079902.106269:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265530
00000004:00000040:5.0:1550079902.106270:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.106271:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265531
00010000:00010000:5.0:1550079902.106272:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb427ef4ec0/0x6bcd99f6a87f7c57 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265531 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff366e0d expref: 265539 pid: 21456 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.106276:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265530
00000020:00000040:5.0:1550079902.106277:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb427ef4ec0 with handle 0x6bcd99f6a87f7c57 from hash
00010000:00000040:5.0:1550079902.106278:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265529
00010000:00000040:5.0:1550079902.106279:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265530
00010000:00010000:5.0:1550079902.106280:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb427ef4ec0/0x6bcd99f6a87f7c57 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265530 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff366e0d expref: 265539 pid: 21456 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.106283:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265529
00010000:00000040:5.0:1550079902.106284:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265528
00010000:00000040:5.0:1550079902.106284:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265536
00000020:00000040:5.0:1550079902.106285:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265538
00000001:00000040:5.0:1550079902.106286:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 97
00010000:00000040:20.0:1550079902.106909:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22368
00000004:00000040:20.0:1550079902.106910:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.106911:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca2289057c0 with handle 0x6bcd99f6a738b716 from hash
00010000:00000040:20.0:1550079902.106912:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22367
00010000:00000040:20.0:1550079902.106913:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22368
00010000:00010000:20.0:1550079902.106915:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca2289057c0/0x6bcd99f6a738b716 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22368 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a90fbe expref: 22368 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.106918:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22367
00010000:00000040:20.0:1550079902.106919:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22366
00010000:00000040:20.0:1550079902.106919:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22366
00000020:00000040:20.0:1550079902.106920:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22367
00000001:00000040:20.0:1550079902.106921:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 76
00010000:00000040:5.0:1550079902.107043:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265529
00000004:00000040:5.0:1550079902.107044:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.107044:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265530
00010000:00010000:5.0:1550079902.107046:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4b1145e80/0x6bcd99f6a84e177f lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265530 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff286e0d expref: 265538 pid: 20645 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.107049:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265529
00000020:00000040:5.0:1550079902.107051:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4b1145e80 with handle 0x6bcd99f6a84e177f from hash
00010000:00000040:5.0:1550079902.107052:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265528
00010000:00000040:5.0:1550079902.107053:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265529
00010000:00010000:5.0:1550079902.107055:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4b1145e80/0x6bcd99f6a84e177f lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265529 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff286e0d expref: 265538 pid: 20645 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.107058:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265528
00010000:00000040:5.0:1550079902.107058:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265527
00010000:00000040:5.0:1550079902.107059:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265535
00000020:00000040:5.0:1550079902.107060:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265537
00000001:00000040:5.0:1550079902.107061:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 98
00010000:00000040:5.0:1550079902.107813:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265528
00000004:00000040:5.0:1550079902.107814:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.107815:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265529
00010000:00010000:5.0:1550079902.107816:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd488675580/0x6bcd99f6a83cb657 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265529 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff216e0d expref: 265537 pid: 20793 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.107819:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265528
00000020:00000040:5.0:1550079902.107820:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd488675580 with handle 0x6bcd99f6a83cb657 from hash
00010000:00000040:5.0:1550079902.107821:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265527
00010000:00000040:5.0:1550079902.107822:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265528
00010000:00010000:5.0:1550079902.107823:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd488675580/0x6bcd99f6a83cb657 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265528 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff216e0d expref: 265537 pid: 20793 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.107826:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265527
00010000:00000040:5.0:1550079902.107827:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265526
00010000:00000040:5.0:1550079902.107827:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265534
00000020:00000040:5.0:1550079902.107828:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265536
00000001:00000040:5.0:1550079902.107829:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 99
00010000:00000040:20.0:1550079902.107885:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22367
00000004:00000040:20.0:1550079902.107886:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.107888:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9de1935c40 with handle 0x6bcd99f6a7063115 from hash
00010000:00000040:20.0:1550079902.107889:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22366
00010000:00000040:20.0:1550079902.107890:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22367
00010000:00010000:20.0:1550079902.107892:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9de1935c40/0x6bcd99f6a7063115 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22367 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a20fbe expref: 22367 pid: 21336 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.107895:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22366
00010000:00000040:20.0:1550079902.107896:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22365
00010000:00000040:20.0:1550079902.107897:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22365
00000020:00000040:20.0:1550079902.107897:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22366
00000001:00000040:20.0:1550079902.107898:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 77
00010000:00000040:5.0:1550079902.108581:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265527
00000004:00000040:5.0:1550079902.108582:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.108582:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265528
00010000:00010000:5.0:1550079902.108584:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc422eb1200/0x6bcd99f6a82b46bf lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265528 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1a6e0d expref: 265536 pid: 21450 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.108588:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265527
00000020:00000040:5.0:1550079902.108590:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc422eb1200 with handle 0x6bcd99f6a82b46bf from hash
00010000:00000040:5.0:1550079902.108591:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265526
00010000:00000040:5.0:1550079902.108591:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265527
00010000:00010000:5.0:1550079902.108593:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc422eb1200/0x6bcd99f6a82b46bf lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265527 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1a6e0d expref: 265536 pid: 21450 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.108596:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265526
00010000:00000040:5.0:1550079902.108596:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265525
00010000:00000040:5.0:1550079902.108597:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265533
00000020:00000040:5.0:1550079902.108598:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265535
00000001:00000040:5.0:1550079902.108599:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 100
00010000:00000040:20.0:1550079902.108859:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22366
00000004:00000040:20.0:1550079902.108864:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.108866:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46d9caf40 with handle 0x6bcd99f6a9860969 from hash
00010000:00000040:20.0:1550079902.108868:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22365
00010000:00000040:20.0:1550079902.108868:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22366
00010000:00010000:20.0:1550079902.108870:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46d9caf40/0x6bcd99f6a9860969 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22366 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ed17be expref: 22366 pid: 21287 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.108873:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22365
00010000:00000040:20.0:1550079902.108874:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22364
00010000:00000040:20.0:1550079902.108875:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22364
00000020:00000040:20.0:1550079902.108876:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22365
00000001:00000040:20.0:1550079902.108877:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 78
00010000:00000040:5.0:1550079902.109354:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265526
00000004:00000040:5.0:1550079902.109355:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.109357:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265527
00010000:00010000:5.0:1550079902.109358:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca4144f3180/0x6bcd99f6a81723a1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265527 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff136e0d expref: 265535 pid: 21833 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.109362:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265526
00000020:00000040:5.0:1550079902.109363:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca4144f3180 with handle 0x6bcd99f6a81723a1 from hash
00010000:00000040:5.0:1550079902.109364:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265525
00010000:00000040:5.0:1550079902.109365:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265526
00010000:00010000:5.0:1550079902.109366:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca4144f3180/0x6bcd99f6a81723a1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265526 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff136e0d expref: 265535 pid: 21833 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.109369:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265525
00010000:00000040:5.0:1550079902.109370:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265524
00010000:00000040:5.0:1550079902.109371:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265532
00000020:00000040:5.0:1550079902.109372:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265534
00000001:00000040:5.0:1550079902.109373:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 101
00010000:00000040:20.0:1550079902.109837:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22365
00000004:00000040:20.0:1550079902.109838:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.109840:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb42f25da00 with handle 0x6bcd99f6a94163db from hash
00010000:00000040:20.0:1550079902.109841:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22364
00010000:00000040:20.0:1550079902.109842:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22365
00010000:00010000:20.0:1550079902.109843:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb42f25da00/0x6bcd99f6a94163db lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22365 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e617be expref: 22365 pid: 21832 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.109847:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22364
00010000:00000040:20.0:1550079902.109848:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22363
00010000:00000040:20.0:1550079902.109849:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22363
00000020:00000040:20.0:1550079902.109849:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22364
00000001:00000040:20.0:1550079902.109851:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 79
00010000:00000040:5.0:1550079902.110129:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265525
00000004:00000040:5.0:1550079902.110130:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.110131:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265526
00010000:00010000:5.0:1550079902.110132:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca2bb39aac0/0x6bcd99f6a8005b51 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265526 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0c6e0d expref: 265534 pid: 20526 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.110136:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265525
00000020:00000040:5.0:1550079902.110137:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca2bb39aac0 with handle 0x6bcd99f6a8005b51 from hash
00010000:00000040:5.0:1550079902.110138:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265524
00010000:00000040:5.0:1550079902.110139:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265525
00010000:00010000:5.0:1550079902.110140:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca2bb39aac0/0x6bcd99f6a8005b51 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265525 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0c6e0d expref: 265534 pid: 20526 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.110143:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265524
00010000:00000040:5.0:1550079902.110144:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265523
00010000:00000040:5.0:1550079902.110145:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265531
00000020:00000040:5.0:1550079902.110146:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265533
00000001:00000040:5.0:1550079902.110147:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 102
00010000:00000040:20.0:1550079902.110814:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22364
00000004:00000040:20.0:1550079902.110815:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.110817:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd497ef5e80 with handle 0x6bcd99f6a90477e2 from hash
00010000:00000040:20.0:1550079902.110818:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22363
00010000:00000040:20.0:1550079902.110819:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22364
00010000:00010000:20.0:1550079902.110821:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd497ef5e80/0x6bcd99f6a90477e2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22364 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52df17be expref: 22364 pid: 20580 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.110824:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22363
00010000:00000040:20.0:1550079902.110824:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22362
00010000:00000040:20.0:1550079902.110825:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22362
00000020:00000040:20.0:1550079902.110826:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22363
00000001:00000040:20.0:1550079902.110827:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 80
00010000:00000040:5.0:1550079902.110903:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265524
00000004:00000040:5.0:1550079902.110904:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.110904:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265525
00010000:00010000:5.0:1550079902.110906:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46c6ab840/0x6bcd99f6a7da6854 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265525 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff056e0d expref: 265533 pid: 21458 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.110909:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265524
00000020:00000040:5.0:1550079902.110911:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46c6ab840 with handle 0x6bcd99f6a7da6854 from hash
00010000:00000040:5.0:1550079902.110913:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265523
00010000:00000040:5.0:1550079902.110913:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265524
00010000:00010000:5.0:1550079902.110915:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46c6ab840/0x6bcd99f6a7da6854 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265524 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff056e0d expref: 265533 pid: 21458 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.110918:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265523
00010000:00000040:5.0:1550079902.110919:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265522
00010000:00000040:5.0:1550079902.110920:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265530
00000020:00000040:5.0:1550079902.110921:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265532
00000001:00000040:5.0:1550079902.110922:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 103
00010000:00000040:5.0:1550079902.111674:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265523
00000004:00000040:5.0:1550079902.111675:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.111676:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265524
00010000:00010000:5.0:1550079902.111677:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd472b12400/0x6bcd99f6a7a65c67 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265524 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefe6e0d expref: 265532 pid: 21711 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.111680:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265523
00000020:00000040:5.0:1550079902.111681:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd472b12400 with handle 0x6bcd99f6a7a65c67 from hash
00010000:00000040:5.0:1550079902.111682:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265522
00010000:00000040:5.0:1550079902.111683:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265523
00010000:00010000:5.0:1550079902.111684:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd472b12400/0x6bcd99f6a7a65c67 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265523 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefe6e0d expref: 265532 pid: 21711 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.111687:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265522
00010000:00000040:5.0:1550079902.111688:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265521
00010000:00000040:5.0:1550079902.111688:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265529
00000020:00000040:5.0:1550079902.111689:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265531
00000001:00000040:5.0:1550079902.111690:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 104
00010000:00000040:20.0:1550079902.111790:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22363
00000004:00000040:20.0:1550079902.111791:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.111793:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4ac2dd7c0 with handle 0x6bcd99f6a8bf6a3b from hash
00010000:00000040:20.0:1550079902.111794:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22362
00010000:00000040:20.0:1550079902.111795:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22363
00010000:00010000:20.0:1550079902.111796:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4ac2dd7c0/0x6bcd99f6a8bf6a3b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22363 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d817be expref: 22363 pid: 21854 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.111800:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22362
00010000:00000040:20.0:1550079902.111800:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22361
00010000:00000040:20.0:1550079902.111801:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22361
00000020:00000040:20.0:1550079902.111802:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22362
00000001:00000040:20.0:1550079902.111803:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 81
00010000:00000040:5.0:1550079902.112442:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265522
00000004:00000040:5.0:1550079902.112443:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.112444:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265523
00010000:00010000:5.0:1550079902.112445:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9efe434140/0x6bcd99f6a7806f67 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265523 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef76e0d expref: 265531 pid: 21840 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.112449:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265522
00000020:00000040:5.0:1550079902.112451:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9efe434140 with handle 0x6bcd99f6a7806f67 from hash
00010000:00000040:5.0:1550079902.112452:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265521
00010000:00000040:5.0:1550079902.112453:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265522
00010000:00010000:5.0:1550079902.112454:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9efe434140/0x6bcd99f6a7806f67 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265522 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef76e0d expref: 265531 pid: 21840 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.112457:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265521
00010000:00000040:5.0:1550079902.112457:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265520
00010000:00000040:5.0:1550079902.112458:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265528
00000020:00000040:5.0:1550079902.112459:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265530
00000001:00000040:5.0:1550079902.112460:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 105
00010000:00000040:20.0:1550079902.112769:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22362
00000004:00000040:20.0:1550079902.112770:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.112771:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc433bc4a40 with handle 0x6bcd99f6a88719fa from hash
00010000:00000040:20.0:1550079902.112772:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22361
00010000:00000040:20.0:1550079902.112773:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22362
00010000:00010000:20.0:1550079902.112775:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc433bc4a40/0x6bcd99f6a88719fa lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22362 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d117be expref: 22362 pid: 21644 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.112778:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22361
00010000:00000040:20.0:1550079902.112778:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22360
00010000:00000040:20.0:1550079902.112779:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22360
00000020:00000040:20.0:1550079902.112780:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22361
00000001:00000040:20.0:1550079902.112781:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 82
00010000:00000040:5.0:1550079902.113217:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265521
00000004:00000040:5.0:1550079902.113218:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.113219:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265522
00010000:00010000:5.0:1550079902.113220:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb422e37bc0/0x6bcd99f6a753f91a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265522 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef06e0d expref: 265530 pid: 21877 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.113224:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265521
00000020:00000040:5.0:1550079902.113225:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb422e37bc0 with handle 0x6bcd99f6a753f91a from hash
00010000:00000040:5.0:1550079902.113226:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265520
00010000:00000040:5.0:1550079902.113227:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265521
00010000:00010000:5.0:1550079902.113228:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb422e37bc0/0x6bcd99f6a753f91a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265521 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef06e0d expref: 265530 pid: 21877 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.113232:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265520
00010000:00000040:5.0:1550079902.113232:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265519
00010000:00000040:5.0:1550079902.113233:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265527
00000020:00000040:5.0:1550079902.113234:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265529
00000001:00000040:5.0:1550079902.113236:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 106
00010000:00000040:20.0:1550079902.113746:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22361
00000004:00000040:20.0:1550079902.113747:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.113749:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb44b2b18c0 with handle 0x6bcd99f6a80b0dfc from hash
00010000:00000040:20.0:1550079902.113750:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22360
00010000:00000040:20.0:1550079902.113751:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22361
00010000:00010000:20.0:1550079902.113752:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb44b2b18c0/0x6bcd99f6a80b0dfc lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22361 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c317be expref: 22361 pid: 21895 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.113755:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22360
00010000:00000040:20.0:1550079902.113756:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22359
00010000:00000040:20.0:1550079902.113757:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22359
00000020:00000040:20.0:1550079902.113758:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22360
00000001:00000040:20.0:1550079902.113759:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 83
00010000:00000040:5.0:1550079902.113991:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265520
00000004:00000040:5.0:1550079902.113992:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.113993:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265521
00010000:00010000:5.0:1550079902.113995:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d43153f00/0x6bcd99f6a7359c6c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265521 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee96e0d expref: 265529 pid: 21721 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.113998:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265520
00000020:00000040:5.0:1550079902.114000:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d43153f00 with handle 0x6bcd99f6a7359c6c from hash
00010000:00000040:5.0:1550079902.114001:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265519
00010000:00000040:5.0:1550079902.114001:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265520
00010000:00010000:5.0:1550079902.114003:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d43153f00/0x6bcd99f6a7359c6c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265520 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee96e0d expref: 265529 pid: 21721 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.114006:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265519
00010000:00000040:5.0:1550079902.114006:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265518
00010000:00000040:5.0:1550079902.114007:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265526
00000020:00000040:5.0:1550079902.114008:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265528
00000001:00000040:5.0:1550079902.114009:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 107
00010000:00000040:20.0:1550079902.114723:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22360
00000004:00000040:20.0:1550079902.114724:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.114725:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f65c8240 with handle 0x6bcd99f6a7b89420 from hash
00010000:00000040:20.0:1550079902.114726:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22359
00010000:00000040:20.0:1550079902.114728:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22360
00010000:00010000:20.0:1550079902.114730:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f65c8240/0x6bcd99f6a7b89420 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22360 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bc17be expref: 22360 pid: 21758 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.114733:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22359
00010000:00000040:20.0:1550079902.114733:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22358
00010000:00000040:20.0:1550079902.114734:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22358
00000020:00000040:20.0:1550079902.114735:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22359
00000001:00000040:20.0:1550079902.114736:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 84
00010000:00000040:5.0:1550079902.114761:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265519
00000004:00000040:5.0:1550079902.114762:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.114763:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265520
00010000:00010000:5.0:1550079902.114764:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc401930900/0x6bcd99f6a709ddca lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265520 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee26e0d expref: 265528 pid: 21803 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.114767:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265519
00000020:00000040:5.0:1550079902.114769:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc401930900 with handle 0x6bcd99f6a709ddca from hash
00010000:00000040:5.0:1550079902.114770:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265518
00010000:00000040:5.0:1550079902.114771:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265519
00010000:00010000:5.0:1550079902.114772:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc401930900/0x6bcd99f6a709ddca lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265519 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee26e0d expref: 265528 pid: 21803 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.114775:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265518
00010000:00000040:5.0:1550079902.114776:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265517
00010000:00000040:5.0:1550079902.114777:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265525
00000020:00000040:5.0:1550079902.114778:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265527
00000001:00000040:5.0:1550079902.114779:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 108
00010000:00000040:5.0:1550079902.115536:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265518
00000004:00000040:5.0:1550079902.115537:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.115537:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265519
00010000:00010000:5.0:1550079902.115539:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb41f71f2c0/0x6bcd99f6a6e75f66 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265519 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedb6e0d expref: 265527 pid: 21736 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.115542:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265518
00000020:00000040:5.0:1550079902.115543:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb41f71f2c0 with handle 0x6bcd99f6a6e75f66 from hash
00010000:00000040:5.0:1550079902.115544:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265517
00010000:00000040:5.0:1550079902.115545:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265518
00010000:00010000:5.0:1550079902.115546:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb41f71f2c0/0x6bcd99f6a6e75f66 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265518 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedb6e0d expref: 265527 pid: 21736 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.115549:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265517
00010000:00000040:5.0:1550079902.115550:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265516
00010000:00000040:5.0:1550079902.115550:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265524
00000020:00000040:5.0:1550079902.115551:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265526
00000001:00000040:5.0:1550079902.115552:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 109
00010000:00000040:20.0:1550079902.115699:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22359
00000004:00000040:20.0:1550079902.115700:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.115701:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d50a24380 with handle 0x6bcd99f6a788c58e from hash
00010000:00000040:20.0:1550079902.115703:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22358
00010000:00000040:20.0:1550079902.115704:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22359
00010000:00010000:20.0:1550079902.115705:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d50a24380/0x6bcd99f6a788c58e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22359 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b517be expref: 22359 pid: 21318 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.115708:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22358
00010000:00000040:20.0:1550079902.115709:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22357
00010000:00000040:20.0:1550079902.115710:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22357
00000020:00000040:20.0:1550079902.115710:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22358
00000001:00000040:20.0:1550079902.115711:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 85
00000100:00000040:41.0F:1550079902.116150:0:20240:0:(events.c:348:request_in_callback()) incoming req@ffff9cb43e7fb300 x1624699740226160 msgsize 224
00000020:00000040:1.0:1550079902.116157:0:20811:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa137d0
00000020:00000040:1.0:1550079902.116161:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca4832fe000 : new refcount 9
00000100:00000040:1.0:1550079902.116164:0:20811:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +743s
00000100:00000040:1.0:1550079902.116167:0:20811:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca4832fe000 : new rpc_count 1
00000100:00000040:1.0:1550079902.116170:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb43e7fb300 x1624699740226160/t0(0) o400->33db19ea-8b3f-bd56-986a-188195b40494@10.9.104.33@o2ib4:720/0 lens 224/0 e 0 to 0 dl 1550080650 ref 1 fl New:H/0/ffffffff rc 0/-1
00010000:00000040:1.0:1550079902.116176:0:20811:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 34361467438, transno 0, xid 1624699740226160
00000100:00000040:1.0:1550079902.116178:0:20811:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f06f2900 refcount 6 to 10.9.104.33@o2ib4
00000100:00000040:1.0:1550079902.116180:0:20811:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.9.104.33@o2ib4
00000100:00000040:1.0:1550079902.116188:0:20811:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f06f2900 refcount 5 to 10.9.104.33@o2ib4
00000100:00000040:1.0:1550079902.116190:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb43e7fb300 x1624699740226160/t0(0) o400->33db19ea-8b3f-bd56-986a-188195b40494@10.9.104.33@o2ib4:720/0 lens 224/192 e 0 to 0 dl 1550080650 ref 1 fl Interpret:H/0/0 rc 0/0
00000100:00000040:43.0F:1550079902.116191:0:20250:0:(events.c:348:request_in_callback()) incoming req@ffff9cb2d6a02450 x1624699740226144 msgsize 224
00000100:00000040:43.0:1550079902.116194:0:20250:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000100:00000040:1.0:1550079902.116194:0:20811:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca4832fe000 : new rpc_count 0
00000020:00000040:1.0:1550079902.116195:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca4832fe000 : new refcount 8
00000020:00000040:11.0:1550079902.116199:0:38445:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f60a042f55
00000020:00000040:11.0:1550079902.116202:0:38445:0:(genops.c:1008:class_export_get()) GETting export ffff9cc3fad1d400 : new refcount 17
00000100:00000040:11.0:1550079902.116205:0:38445:0:(service.c:1210:ptlrpc_at_set_timer()) armed mgs at +38s
00000100:00000040:11.0:1550079902.116208:0:38445:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9cc3fad1d400 : new rpc_count 1
00000100:00000040:11.0:1550079902.116210:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb2d6a02450 x1624699740226144/t0(0) o400->e7977f5e-44fb-aed0-978a-e96873bf64b8@10.9.104.33@o2ib4:15/0 lens 224/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00000040:11.0:1550079902.116215:0:38445:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 0, transno 0, xid 1624699740226144
00000100:00000040:11.0:1550079902.116218:0:38445:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f06f2900 refcount 6 to 10.9.104.33@o2ib4
00000100:00000040:11.0:1550079902.116220:0:38445:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.9.104.33@o2ib4
00000100:00000040:11.0:1550079902.116229:0:38445:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f06f2900 refcount 5 to 10.9.104.33@o2ib4
00000100:00000040:11.0:1550079902.116230:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb2d6a02450 x1624699740226144/t0(0) o400->e7977f5e-44fb-aed0-978a-e96873bf64b8@10.9.104.33@o2ib4:15/0 lens 224/192 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:11.0:1550079902.116234:0:38445:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9cc3fad1d400 : new rpc_count 0
00000020:00000040:11.0:1550079902.116236:0:38445:0:(genops.c:1018:class_export_put()) PUTting export ffff9cc3fad1d400 : new refcount 16
00010000:00000040:5.0:1550079902.116304:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265517
00000004:00000040:5.0:1550079902.116305:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.116305:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265518
00010000:00010000:5.0:1550079902.116307:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc414722640/0x6bcd99f6a6be2ef0 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265518 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed46e0d expref: 265526 pid: 21800 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.116311:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265517
00000020:00000040:5.0:1550079902.116313:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc414722640 with handle 0x6bcd99f6a6be2ef0 from hash
00010000:00000040:5.0:1550079902.116314:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265516
00010000:00000040:5.0:1550079902.116315:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265517
00010000:00010000:5.0:1550079902.116316:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc414722640/0x6bcd99f6a6be2ef0 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265517 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed46e0d expref: 265526 pid: 21800 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.116319:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265516
00010000:00000040:5.0:1550079902.116319:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265515
00010000:00000040:5.0:1550079902.116320:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265523
00000020:00000040:5.0:1550079902.116321:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265525
00000001:00000040:5.0:1550079902.116322:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 110
00010000:00000040:20.0:1550079902.116675:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22358
00000004:00000040:20.0:1550079902.116676:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.116678:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd490b3ad00 with handle 0x6bcd99f6a7567008 from hash
00010000:00000040:20.0:1550079902.116679:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22357
00010000:00000040:20.0:1550079902.116680:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22358
00010000:00010000:20.0:1550079902.116681:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd490b3ad00/0x6bcd99f6a7567008 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22358 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ae17be expref: 22358 pid: 21271 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.116688:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22357
00010000:00000040:20.0:1550079902.116689:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22356
00010000:00000040:20.0:1550079902.116689:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22356
00000020:00000040:20.0:1550079902.116690:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22357
00000001:00000040:20.0:1550079902.116692:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 86
00010000:00000040:5.0:1550079902.117078:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265516
00000004:00000040:5.0:1550079902.117079:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.117080:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265517
00010000:00010000:5.0:1550079902.117081:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc41998e0c0/0x6bcd99f6a6912820 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265517 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecd6e0d expref: 265525 pid: 21828 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.117085:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265516
00000020:00000040:5.0:1550079902.117086:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc41998e0c0 with handle 0x6bcd99f6a6912820 from hash
00010000:00000040:5.0:1550079902.117087:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265515
00010000:00000040:5.0:1550079902.117088:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265516
00010000:00010000:5.0:1550079902.117089:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc41998e0c0/0x6bcd99f6a6912820 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265516 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecd6e0d expref: 265525 pid: 21828 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.117092:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265515
00010000:00000040:5.0:1550079902.117093:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265514
00010000:00000040:5.0:1550079902.117094:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265522
00000020:00000040:5.0:1550079902.117095:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265524
00000001:00000040:5.0:1550079902.117096:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 111
00010000:00000040:20.0:1550079902.117656:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22357
00000004:00000040:20.0:1550079902.117657:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.117659:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46778bcc0 with handle 0x6bcd99f6a727704a from hash
00010000:00000040:20.0:1550079902.117660:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22356
00010000:00000040:20.0:1550079902.117661:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22357
00010000:00010000:20.0:1550079902.117662:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46778bcc0/0x6bcd99f6a727704a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22357 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a717be expref: 22357 pid: 20581 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.117665:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22356
00010000:00000040:20.0:1550079902.117666:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22355
00010000:00000040:20.0:1550079902.117667:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22355
00000020:00000040:20.0:1550079902.117668:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22356
00000001:00000040:20.0:1550079902.117669:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 87
00010000:00000040:5.0:1550079902.117848:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265515
00000004:00000040:5.0:1550079902.117849:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.117850:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265516
00010000:00010000:5.0:1550079902.117852:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb33ea65580/0x6bcd99f6a893d091 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265516 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3b760d expref: 265524 pid: 21767 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.117855:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265515
00000020:00000040:5.0:1550079902.117856:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb33ea65580 with handle 0x6bcd99f6a893d091 from hash
00010000:00000040:5.0:1550079902.117857:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265514
00010000:00000040:5.0:1550079902.117858:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265515
00010000:00010000:5.0:1550079902.117859:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb33ea65580/0x6bcd99f6a893d091 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265515 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3b760d expref: 265524 pid: 21767 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.117867:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265514
00010000:00000040:5.0:1550079902.117868:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265513
00010000:00000040:5.0:1550079902.117869:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265521
00000020:00000040:5.0:1550079902.117869:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265523
00000001:00000040:5.0:1550079902.117870:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 112
00010000:00000040:5.0:1550079902.118623:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265514
00000004:00000040:5.0:1550079902.118624:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.118624:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265515
00010000:00010000:5.0:1550079902.118626:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e40e84c80/0x6bcd99f6a8789604 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265515 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff34760d expref: 265523 pid: 20616 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.118629:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265514
00000020:00000040:5.0:1550079902.118630:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e40e84c80 with handle 0x6bcd99f6a8789604 from hash
00010000:00000040:5.0:1550079902.118631:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265513
00010000:00000040:20.0:1550079902.118632:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22356
00010000:00000040:5.0:1550079902.118632:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265514
00000004:00000040:20.0:1550079902.118633:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00010000:00010000:5.0:1550079902.118634:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e40e84c80/0x6bcd99f6a8789604 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265514 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff34760d expref: 265523 pid: 20616 timeout: 62414 lvb_type: 0
00000020:00000040:20.0:1550079902.118635:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd499ffb840 with handle 0x6bcd99f6a97cfd8f from hash
00010000:00000040:20.0:1550079902.118636:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22355
00010000:00000040:20.0:1550079902.118637:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22356
00010000:00000040:5.0:1550079902.118638:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265513
00010000:00000040:5.0:1550079902.118638:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265512
00010000:00010000:20.0:1550079902.118639:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd499ffb840/0x6bcd99f6a97cfd8f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22356 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52eb1fbe expref: 22356 pid: 21840 timeout: 0 lvb_type: 0
00010000:00000040:5.0:1550079902.118639:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265520
00000020:00000040:5.0:1550079902.118639:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265522
00000001:00000040:5.0:1550079902.118640:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 113
00010000:00000040:20.0:1550079902.118642:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22355
00010000:00000040:20.0:1550079902.118643:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22354
00010000:00000040:20.0:1550079902.118644:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22354
00000020:00000040:20.0:1550079902.118645:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22355
00000001:00000040:20.0:1550079902.118646:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 88
00010000:00000040:5.0:1550079902.119395:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265513
00000004:00000040:5.0:1550079902.119396:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.119397:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265514
00010000:00010000:5.0:1550079902.119398:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc441d20900/0x6bcd99f6a860e24d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265514 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2d760d expref: 265522 pid: 21356 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.119402:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265513
00000020:00000040:5.0:1550079902.119403:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc441d20900 with handle 0x6bcd99f6a860e24d from hash
00010000:00000040:5.0:1550079902.119404:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265512
00010000:00000040:5.0:1550079902.119405:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265513
00010000:00010000:5.0:1550079902.119406:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc441d20900/0x6bcd99f6a860e24d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265513 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2d760d expref: 265522 pid: 21356 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.119409:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265512
00010000:00000040:5.0:1550079902.119410:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265511
00010000:00000040:5.0:1550079902.119411:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265519
00000020:00000040:5.0:1550079902.119412:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265521
00000001:00000040:5.0:1550079902.119413:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 114
00010000:00000040:20.0:1550079902.119610:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22355
00000004:00000040:20.0:1550079902.119611:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.119612:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb473af2ac0 with handle 0x6bcd99f6a92c7da4 from hash
00010000:00000040:20.0:1550079902.119614:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22354
00010000:00000040:20.0:1550079902.119615:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22355
00010000:00010000:20.0:1550079902.119616:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb473af2ac0/0x6bcd99f6a92c7da4 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22355 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e41fbe expref: 22355 pid: 21772 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.119619:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22354
00010000:00000040:20.0:1550079902.119620:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22353
00010000:00000040:20.0:1550079902.119621:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22353
00000020:00000040:20.0:1550079902.119621:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22354
00000001:00000040:20.0:1550079902.119623:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 89
00010000:00000040:5.0:1550079902.120165:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265512
00000004:00000040:5.0:1550079902.120166:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.120167:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265513
00010000:00010000:5.0:1550079902.120169:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb420a60240/0x6bcd99f6a849f15b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265513 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff26760d expref: 265521 pid: 20645 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.120173:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265512
00000020:00000040:5.0:1550079902.120174:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb420a60240 with handle 0x6bcd99f6a849f15b from hash
00010000:00000040:5.0:1550079902.120175:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265511
00010000:00000040:5.0:1550079902.120176:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265512
00010000:00010000:5.0:1550079902.120177:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb420a60240/0x6bcd99f6a849f15b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265512 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff26760d expref: 265521 pid: 20645 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.120180:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265511
00010000:00000040:5.0:1550079902.120181:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265510
00010000:00000040:5.0:1550079902.120182:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265518
00000020:00000040:5.0:1550079902.120182:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265520
00000001:00000040:5.0:1550079902.120183:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 115
00010000:00000040:20.0:1550079902.120587:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22354
00000004:00000040:20.0:1550079902.120588:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.120589:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f1bde300 with handle 0x6bcd99f6a8aff662 from hash
00010000:00000040:20.0:1550079902.120591:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22353
00010000:00000040:20.0:1550079902.120592:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22354
00010000:00010000:20.0:1550079902.120593:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f1bde300/0x6bcd99f6a8aff662 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22354 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d61fbe expref: 22354 pid: 21271 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.120596:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22353
00010000:00000040:20.0:1550079902.120597:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22352
00010000:00000040:20.0:1550079902.120598:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22352
00000020:00000040:20.0:1550079902.120599:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22353
00000001:00000040:20.0:1550079902.120600:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 90
00010000:00000040:5.0:1550079902.120938:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265511
00000004:00000040:5.0:1550079902.120939:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.120940:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265512
00010000:00010000:5.0:1550079902.120942:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4949cbf00/0x6bcd99f6a83888c3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265512 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1f760d expref: 265520 pid: 21808 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.120945:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265511
00000020:00000040:5.0:1550079902.120947:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4949cbf00 with handle 0x6bcd99f6a83888c3 from hash
00010000:00000040:5.0:1550079902.120948:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265510
00010000:00000040:5.0:1550079902.120948:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265511
00010000:00010000:5.0:1550079902.120950:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4949cbf00/0x6bcd99f6a83888c3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265511 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1f760d expref: 265520 pid: 21808 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.120953:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265510
00010000:00000040:5.0:1550079902.120953:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265509
00010000:00000040:5.0:1550079902.120954:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265517
00000020:00000040:5.0:1550079902.120956:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265519
00000001:00000040:5.0:1550079902.120957:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 116
00010000:00000040:20.0:1550079902.121564:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22353
00000004:00000040:20.0:1550079902.121565:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.121566:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca0e3925580 with handle 0x6bcd99f6a871c7f2 from hash
00010000:00000040:20.0:1550079902.121567:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22352
00010000:00000040:20.0:1550079902.121568:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22353
00010000:00010000:20.0:1550079902.121570:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca0e3925580/0x6bcd99f6a871c7f2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22353 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cf1fbe expref: 22353 pid: 21845 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.121573:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22352
00010000:00000040:20.0:1550079902.121574:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22351
00010000:00000040:20.0:1550079902.121574:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22351
00000020:00000040:20.0:1550079902.121575:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22352
00000001:00000040:20.0:1550079902.121576:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 91
00010000:00000040:5.0:1550079902.121709:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265510
00000004:00000040:5.0:1550079902.121710:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.121711:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265511
00010000:00010000:5.0:1550079902.121713:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc456ef7980/0x6bcd99f6a824e898 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265511 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff18760d expref: 265519 pid: 21581 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.121716:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265510
00000020:00000040:5.0:1550079902.121717:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc456ef7980 with handle 0x6bcd99f6a824e898 from hash
00010000:00000040:5.0:1550079902.121718:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265509
00010000:00000040:5.0:1550079902.121719:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265510
00010000:00010000:5.0:1550079902.121720:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc456ef7980/0x6bcd99f6a824e898 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265510 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff18760d expref: 265519 pid: 21581 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.121723:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265509
00010000:00000040:5.0:1550079902.121724:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265508
00010000:00000040:5.0:1550079902.121725:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265516
00000020:00000040:5.0:1550079902.121726:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265518
00000001:00000040:5.0:1550079902.121727:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 117
00010000:00000040:5.0:1550079902.122483:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265509
00000004:00000040:5.0:1550079902.122484:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.122485:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265510
00010000:00010000:5.0:1550079902.122486:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc470243840/0x6bcd99f6a80e50a0 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265510 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff11760d expref: 265518 pid: 21843 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.122489:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265509
00000020:00000040:5.0:1550079902.122491:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc470243840 with handle 0x6bcd99f6a80e50a0 from hash
00010000:00000040:5.0:1550079902.122492:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265508
00010000:00000040:5.0:1550079902.122492:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265509
00010000:00010000:5.0:1550079902.122494:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc470243840/0x6bcd99f6a80e50a0 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265509 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff11760d expref: 265518 pid: 21843 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.122497:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265508
00010000:00000040:5.0:1550079902.122498:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265507
00010000:00000040:5.0:1550079902.122499:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265515
00000020:00000040:5.0:1550079902.122499:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265517
00000001:00000040:5.0:1550079902.122500:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 118
00010000:00000040:20.0:1550079902.122541:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22352
00000004:00000040:20.0:1550079902.122542:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.122544:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb457f56540 with handle 0x6bcd99f6a824fcb1 from hash
00010000:00000040:20.0:1550079902.122545:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22351
00010000:00000040:20.0:1550079902.122546:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22352
00010000:00010000:20.0:1550079902.122548:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb457f56540/0x6bcd99f6a824fcb1 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22352 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c81fbe expref: 22352 pid: 21736 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.122551:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22351
00010000:00000040:20.0:1550079902.122551:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22350
00010000:00000040:20.0:1550079902.122552:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22350
00000020:00000040:20.0:1550079902.122553:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22351
00000001:00000040:20.0:1550079902.122554:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 92
00010000:00000040:5.0:1550079902.123252:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265508
00000004:00000040:5.0:1550079902.123253:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.123254:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265509
00010000:00010000:5.0:1550079902.123255:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc400f433c0/0x6bcd99f6a7fa9f73 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265509 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0a760d expref: 265517 pid: 21356 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.123259:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265508
00000020:00000040:5.0:1550079902.123260:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc400f433c0 with handle 0x6bcd99f6a7fa9f73 from hash
00010000:00000040:5.0:1550079902.123261:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265507
00010000:00000040:5.0:1550079902.123262:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265508
00010000:00010000:5.0:1550079902.123263:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc400f433c0/0x6bcd99f6a7fa9f73 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265508 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0a760d expref: 265517 pid: 21356 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.123266:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265507
00010000:00000040:5.0:1550079902.123267:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265506
00010000:00000040:5.0:1550079902.123268:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265514
00000020:00000040:5.0:1550079902.123268:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265516
00000001:00000040:5.0:1550079902.123270:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 119
00010000:00000040:20.0:1550079902.123519:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22351
00000004:00000040:20.0:1550079902.123519:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.123521:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e22a79680 with handle 0x6bcd99f6a7f05de0 from hash
00010000:00000040:20.0:1550079902.123522:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22350
00010000:00000040:20.0:1550079902.123523:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22351
00010000:00010000:20.0:1550079902.123525:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e22a79680/0x6bcd99f6a7f05de0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22351 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c11fbe expref: 22351 pid: 21792 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.123528:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22350
00010000:00000040:20.0:1550079902.123529:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22349
00010000:00000040:20.0:1550079902.123530:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22349
00000020:00000040:20.0:1550079902.123531:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22350
00000001:00000040:20.0:1550079902.123532:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 93
00010000:00000040:5.0:1550079902.124026:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265507
00000004:00000040:5.0:1550079902.124027:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.124028:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265508
00010000:00010000:5.0:1550079902.124029:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9ea67233c0/0x6bcd99f6a7cf32cb lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265508 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff03760d expref: 265516 pid: 21336 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.124033:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265507
00000020:00000040:5.0:1550079902.124035:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9ea67233c0 with handle 0x6bcd99f6a7cf32cb from hash
00010000:00000040:5.0:1550079902.124036:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265506
00010000:00000040:5.0:1550079902.124037:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265507
00010000:00010000:5.0:1550079902.124038:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9ea67233c0/0x6bcd99f6a7cf32cb lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265507 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff03760d expref: 265516 pid: 21336 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.124041:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265506
00010000:00000040:5.0:1550079902.124042:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265505
00010000:00000040:5.0:1550079902.124042:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265513
00000020:00000040:5.0:1550079902.124043:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265515
00000001:00000040:5.0:1550079902.124044:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 120
00010000:00000040:20.0:1550079902.124496:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22350
00000004:00000040:20.0:1550079902.124497:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.124499:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9da8a7c380 with handle 0x6bcd99f6a7a8e31c from hash
00010000:00000040:20.0:1550079902.124500:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22349
00010000:00000040:20.0:1550079902.124501:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22350
00010000:00010000:20.0:1550079902.124503:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9da8a7c380/0x6bcd99f6a7a8e31c lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22350 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ba1fbe expref: 22350 pid: 21794 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.124506:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22349
00010000:00000040:20.0:1550079902.124506:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22348
00010000:00000040:20.0:1550079902.124507:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22348
00000020:00000040:20.0:1550079902.124508:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22349
00000001:00000040:20.0:1550079902.124509:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 94
00010000:00000040:5.0:1550079902.124796:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265506
00000004:00000040:5.0:1550079902.124797:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.124798:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265507
00010000:00010000:5.0:1550079902.124799:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd458015580/0x6bcd99f6a7973835 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265507 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefc760d expref: 265515 pid: 21711 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.124803:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265506
00000020:00000040:5.0:1550079902.124804:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd458015580 with handle 0x6bcd99f6a7973835 from hash
00010000:00000040:5.0:1550079902.124805:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265505
00010000:00000040:5.0:1550079902.124806:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265506
00010000:00010000:5.0:1550079902.124808:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd458015580/0x6bcd99f6a7973835 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265506 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefc760d expref: 265515 pid: 21711 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.124811:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265505
00010000:00000040:5.0:1550079902.124811:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265504
00010000:00000040:5.0:1550079902.124812:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265512
00000020:00000040:5.0:1550079902.124814:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265514
00000001:00000040:5.0:1550079902.124815:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 121
00010000:00000040:20.0:1550079902.125474:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22349
00000004:00000040:20.0:1550079902.125475:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.125477:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd44d629440 with handle 0x6bcd99f6a776188e from hash
00010000:00000040:20.0:1550079902.125478:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22348
00010000:00000040:20.0:1550079902.125479:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22349
00010000:00010000:20.0:1550079902.125481:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd44d629440/0x6bcd99f6a776188e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22349 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b31fbe expref: 22349 pid: 21318 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.125484:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22348
00010000:00000040:20.0:1550079902.125485:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22347
00010000:00000040:20.0:1550079902.125486:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22347
00000020:00000040:20.0:1550079902.125487:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22348
00000001:00000040:20.0:1550079902.125488:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 95
00010000:00000040:5.0:1550079902.125571:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265505
00000004:00000040:5.0:1550079902.125572:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.125573:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265506
00010000:00010000:5.0:1550079902.125574:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb42f971680/0x6bcd99f6a774ec44 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265506 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef5760d expref: 265514 pid: 21745 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.125578:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265505
00000020:00000040:5.0:1550079902.125579:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb42f971680 with handle 0x6bcd99f6a774ec44 from hash
00010000:00000040:5.0:1550079902.125580:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265504
00010000:00000040:5.0:1550079902.125581:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265505
00010000:00010000:5.0:1550079902.125582:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb42f971680/0x6bcd99f6a774ec44 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265505 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef5760d expref: 265514 pid: 21745 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.125585:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265504
00010000:00000040:5.0:1550079902.125586:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265503
00010000:00000040:5.0:1550079902.125587:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265511
00000020:00000040:5.0:1550079902.125587:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265513
00000001:00000040:5.0:1550079902.125589:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 122
00010000:00000040:5.0:1550079902.126345:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265504
00000004:00000040:5.0:1550079902.126346:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.126347:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265505
00010000:00010000:5.0:1550079902.126348:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd45e704380/0x6bcd99f6a74b4b49 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265505 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feee760d expref: 265513 pid: 21884 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.126351:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265504
00000020:00000040:5.0:1550079902.126353:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45e704380 with handle 0x6bcd99f6a74b4b49 from hash
00010000:00000040:5.0:1550079902.126354:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265503
00010000:00000040:5.0:1550079902.126354:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265504
00010000:00010000:5.0:1550079902.126356:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45e704380/0x6bcd99f6a74b4b49 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265504 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feee760d expref: 265513 pid: 21884 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.126359:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265503
00010000:00000040:5.0:1550079902.126360:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265502
00010000:00000040:5.0:1550079902.126360:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265510
00000020:00000040:5.0:1550079902.126361:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265512
00000001:00000040:5.0:1550079902.126362:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 123
00010000:00000040:20.0:1550079902.126453:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22348
00000004:00000040:20.0:1550079902.126454:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.126456:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9ff3226300 with handle 0x6bcd99f6a74f7437 from hash
00010000:00000040:20.0:1550079902.126457:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22347
00010000:00000040:20.0:1550079902.126458:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22348
00010000:00010000:20.0:1550079902.126460:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9ff3226300/0x6bcd99f6a74f7437 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22348 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ac1fbe expref: 22348 pid: 21336 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.126463:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22347
00010000:00000040:20.0:1550079902.126463:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22346
00010000:00000040:20.0:1550079902.126464:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22346
00000020:00000040:20.0:1550079902.126465:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22347
00000001:00000040:20.0:1550079902.126466:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 96
00010000:00000040:5.0:1550079902.127114:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265503
00000004:00000040:5.0:1550079902.127115:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.127116:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265504
00010000:00010000:5.0:1550079902.127117:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4d3b80fc0/0x6bcd99f6a724c855 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265504 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee7760d expref: 265512 pid: 20532 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.127121:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265503
00000020:00000040:5.0:1550079902.127122:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4d3b80fc0 with handle 0x6bcd99f6a724c855 from hash
00010000:00000040:5.0:1550079902.127123:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265502
00010000:00000040:5.0:1550079902.127124:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265503
00010000:00010000:5.0:1550079902.127125:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4d3b80fc0/0x6bcd99f6a724c855 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265503 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee7760d expref: 265512 pid: 20532 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.127128:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265502
00010000:00000040:5.0:1550079902.127129:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265501
00010000:00000040:5.0:1550079902.127130:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265509
00000020:00000040:5.0:1550079902.127131:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265511
00000001:00000040:5.0:1550079902.127132:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 124
00010000:00000040:20.0:1550079902.127429:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22347
00000004:00000040:20.0:1550079902.127430:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.127431:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca41006b3c0 with handle 0x6bcd99f6a7197823 from hash
00010000:00000040:20.0:1550079902.127432:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22346
00010000:00000040:20.0:1550079902.127433:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22347
00010000:00010000:20.0:1550079902.127435:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca41006b3c0/0x6bcd99f6a7197823 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22347 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a51fbe expref: 22347 pid: 21341 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.127438:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22346
00010000:00000040:20.0:1550079902.127439:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22345
00010000:00000040:20.0:1550079902.127439:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22345
00000020:00000040:20.0:1550079902.127440:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22346
00000001:00000040:20.0:1550079902.127441:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 97
00010000:00000040:5.0:1550079902.127888:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265502
00000004:00000040:5.0:1550079902.127888:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.127889:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265503
00010000:00010000:5.0:1550079902.127891:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f6ef1440/0x6bcd99f6a7020b68 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265503 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee0760d expref: 265511 pid: 20616 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.127895:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265502
00000020:00000040:5.0:1550079902.127896:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3f6ef1440 with handle 0x6bcd99f6a7020b68 from hash
00010000:00000040:5.0:1550079902.127897:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265501
00010000:00000040:5.0:1550079902.127898:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265502
00010000:00010000:5.0:1550079902.127899:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f6ef1440/0x6bcd99f6a7020b68 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265502 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee0760d expref: 265511 pid: 20616 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.127902:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265501
00010000:00000040:5.0:1550079902.127903:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265500
00010000:00000040:5.0:1550079902.127904:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265508
00000020:00000040:5.0:1550079902.127905:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265510
00000001:00000040:5.0:1550079902.127906:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 125
00010000:00000040:20.0:1550079902.128407:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22346
00000004:00000040:20.0:1550079902.128408:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.128410:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3ff3f8240 with handle 0x6bcd99f6a96a40ba from hash
00010000:00000040:20.0:1550079902.128411:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22345
00010000:00000040:20.0:1550079902.128412:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22346
00010000:00010000:20.0:1550079902.128414:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3ff3f8240/0x6bcd99f6a96a40ba lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22346 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e927be expref: 22346 pid: 21752 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.128417:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22345
00010000:00000040:20.0:1550079902.128418:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22344
00010000:00000040:20.0:1550079902.128419:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22344
00000020:00000040:20.0:1550079902.128419:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22345
00000001:00000040:20.0:1550079902.128421:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 98
00010000:00000040:5.0:1550079902.128658:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265501
00000004:00000040:5.0:1550079902.128659:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.128660:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265502
00010000:00010000:5.0:1550079902.128661:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd48b818d80/0x6bcd99f6a6dafdee lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265502 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed9760d expref: 265510 pid: 21820 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.128664:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265501
00000020:00000040:5.0:1550079902.128666:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48b818d80 with handle 0x6bcd99f6a6dafdee from hash
00010000:00000040:5.0:1550079902.128667:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265500
00010000:00000040:5.0:1550079902.128668:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265501
00010000:00010000:5.0:1550079902.128669:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48b818d80/0x6bcd99f6a6dafdee lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265501 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed9760d expref: 265510 pid: 21820 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.128672:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265500
00010000:00000040:5.0:1550079902.128673:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265499
00010000:00000040:5.0:1550079902.128673:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265507
00000020:00000040:5.0:1550079902.128675:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265509
00000001:00000040:5.0:1550079902.128676:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 126
00010000:00000040:20.0:1550079902.129386:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22345
00000004:00000040:20.0:1550079902.129387:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.129389:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48db4d580 with handle 0x6bcd99f6a8e2d7d3 from hash
00010000:00000040:20.0:1550079902.129390:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22344
00010000:00000040:20.0:1550079902.129391:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22345
00010000:00010000:20.0:1550079902.129393:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48db4d580/0x6bcd99f6a8e2d7d3 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22345 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52db27be expref: 22345 pid: 21449 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.129396:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22344
00010000:00000040:20.0:1550079902.129396:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22343
00010000:00000040:20.0:1550079902.129397:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22343
00000020:00000040:20.0:1550079902.129398:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22344
00000001:00000040:20.0:1550079902.129399:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 99
00010000:00000040:5.0:1550079902.129432:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265500
00000004:00000040:5.0:1550079902.129432:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.129433:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265501
00010000:00010000:5.0:1550079902.129435:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd3ebab60c0/0x6bcd99f6a6b6ddf9 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265501 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed2760d expref: 265509 pid: 21458 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.129438:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265500
00000020:00000040:5.0:1550079902.129440:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3ebab60c0 with handle 0x6bcd99f6a6b6ddf9 from hash
00010000:00000040:5.0:1550079902.129441:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265499
00010000:00000040:5.0:1550079902.129442:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265500
00010000:00010000:5.0:1550079902.129443:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3ebab60c0/0x6bcd99f6a6b6ddf9 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265500 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed2760d expref: 265509 pid: 21458 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.129446:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265499
00010000:00000040:5.0:1550079902.129447:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265498
00010000:00000040:5.0:1550079902.129447:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265506
00000020:00000040:5.0:1550079902.129448:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265508
00000001:00000040:5.0:1550079902.129449:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 127
00010000:00000040:5.0:1550079902.130205:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265499
00000004:00000040:5.0:1550079902.130206:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.130206:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265500
00010000:00010000:5.0:1550079902.130208:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4676fd7c0/0x6bcd99f6a68047fa lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265500 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecb760d expref: 265508 pid: 21725 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.130211:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265499
00000020:00000040:5.0:1550079902.130212:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4676fd7c0 with handle 0x6bcd99f6a68047fa from hash
00010000:00000040:5.0:1550079902.130213:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265498
00010000:00000040:5.0:1550079902.130214:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265499
00010000:00010000:5.0:1550079902.130216:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4676fd7c0/0x6bcd99f6a68047fa lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265499 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecb760d expref: 265508 pid: 21725 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.130219:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265498
00010000:00000040:5.0:1550079902.130219:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265497
00010000:00000040:5.0:1550079902.130220:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265505
00000020:00000040:5.0:1550079902.130220:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265507
00000001:00000040:5.0:1550079902.130221:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 128
00010000:00000040:20.0:1550079902.130363:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22344
00000004:00000040:20.0:1550079902.130365:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.130366:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3ebfdcc80 with handle 0x6bcd99f6a89b724e from hash
00010000:00000040:20.0:1550079902.130367:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22343
00010000:00000040:20.0:1550079902.130369:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22344
00010000:00010000:20.0:1550079902.130371:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3ebfdcc80/0x6bcd99f6a89b724e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22344 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d427be expref: 22344 pid: 20644 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.130374:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22343
00010000:00000040:20.0:1550079902.130374:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22342
00010000:00000040:20.0:1550079902.130375:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22342
00000020:00000040:20.0:1550079902.130376:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22343
00000001:00000040:20.0:1550079902.130377:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 100
00010000:00000040:5.0:1550079902.130973:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265498
00000004:00000040:5.0:1550079902.130974:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.130974:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265499
00010000:00010000:5.0:1550079902.130976:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb408705580/0x6bcd99f6a88da577 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265499 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff397e0d expref: 265507 pid: 21895 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.130979:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265498
00000020:00000040:5.0:1550079902.130981:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb408705580 with handle 0x6bcd99f6a88da577 from hash
00010000:00000040:5.0:1550079902.130982:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265497
00010000:00000040:5.0:1550079902.130983:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265498
00010000:00010000:5.0:1550079902.130984:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb408705580/0x6bcd99f6a88da577 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265498 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff397e0d expref: 265507 pid: 21895 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.130987:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265497
00010000:00000040:5.0:1550079902.130988:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265496
00010000:00000040:5.0:1550079902.130988:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265504
00000020:00000040:5.0:1550079902.130989:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265506
00000001:00000040:5.0:1550079902.130991:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 129
00010000:00000040:20.0:1550079902.131341:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22343
00000004:00000040:20.0:1550079902.131342:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.131344:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca36b02f740 with handle 0x6bcd99f6a85f4d26 from hash
00010000:00000040:20.0:1550079902.131345:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22342
00010000:00000040:20.0:1550079902.131346:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22343
00010000:00010000:20.0:1550079902.131347:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca36b02f740/0x6bcd99f6a85f4d26 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22343 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cd27be expref: 22343 pid: 21346 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.131350:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22342
00010000:00000040:20.0:1550079902.131351:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22341
00010000:00000040:20.0:1550079902.131352:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22341
00000020:00000040:20.0:1550079902.131353:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22342
00000001:00000040:20.0:1550079902.131354:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 101
00010000:00000040:5.0:1550079902.131742:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265497
00000004:00000040:5.0:1550079902.131743:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.131744:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265498
00010000:00010000:5.0:1550079902.131746:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd485ab0d80/0x6bcd99f6a8714e67 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265498 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff327e0d expref: 265506 pid: 21820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.131750:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265497
00000020:00000040:5.0:1550079902.131752:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd485ab0d80 with handle 0x6bcd99f6a8714e67 from hash
00010000:00000040:5.0:1550079902.131753:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265496
00010000:00000040:5.0:1550079902.131753:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265497
00010000:00010000:5.0:1550079902.131755:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd485ab0d80/0x6bcd99f6a8714e67 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265497 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff327e0d expref: 265506 pid: 21820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.131758:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265496
00010000:00000040:5.0:1550079902.131758:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265495
00010000:00000040:5.0:1550079902.131759:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265503
00000020:00000040:5.0:1550079902.131760:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265505
00000001:00000040:5.0:1550079902.131761:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 130
00010000:00000040:20.0:1550079902.132319:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22342
00000004:00000040:20.0:1550079902.132320:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.132322:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9de7938d80 with handle 0x6bcd99f6a81b31ed from hash
00010000:00000040:20.0:1550079902.132323:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22341
00010000:00000040:20.0:1550079902.132324:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22342
00010000:00010000:20.0:1550079902.132325:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9de7938d80/0x6bcd99f6a81b31ed lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22342 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c627be expref: 22342 pid: 21833 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.132332:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22341
00010000:00000040:20.0:1550079902.132333:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22340
00010000:00000040:20.0:1550079902.132333:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22340
00000020:00000040:20.0:1550079902.132334:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22341
00000001:00000040:20.0:1550079902.132335:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 102
00010000:00000040:5.0:1550079902.132518:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265496
00000004:00000040:5.0:1550079902.132519:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.132519:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265497
00010000:00010000:5.0:1550079902.132521:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4768e5c40/0x6bcd99f6a85a7339 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265497 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2b7e0d expref: 265505 pid: 20774 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.132524:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265496
00000020:00000040:5.0:1550079902.132526:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4768e5c40 with handle 0x6bcd99f6a85a7339 from hash
00010000:00000040:5.0:1550079902.132527:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265495
00010000:00000040:5.0:1550079902.132527:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265496
00010000:00010000:5.0:1550079902.132529:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4768e5c40/0x6bcd99f6a85a7339 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265496 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2b7e0d expref: 265505 pid: 20774 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.132532:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265495
00010000:00000040:5.0:1550079902.132532:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265494
00010000:00000040:5.0:1550079902.132533:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265502
00000020:00000040:5.0:1550079902.132535:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265504
00000001:00000040:5.0:1550079902.132536:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 131
00010000:00000040:5.0:1550079902.133291:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265495
00000004:00000040:5.0:1550079902.133292:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.133293:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265496
00010000:00010000:5.0:1550079902.133294:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4376c72c0/0x6bcd99f6a844283a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265496 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff247e0d expref: 265504 pid: 21356 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.133298:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265495
00000020:00000040:5.0:1550079902.133299:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4376c72c0 with handle 0x6bcd99f6a844283a from hash
00010000:00000040:20.0:1550079902.133300:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22341
00010000:00000040:5.0:1550079902.133300:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265494
00000004:00000040:20.0:1550079902.133301:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00010000:00000040:5.0:1550079902.133301:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265495
00000020:00000040:20.0:1550079902.133302:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc42d984800 with handle 0x6bcd99f6a7d1bbf6 from hash
00010000:00010000:5.0:1550079902.133302:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4376c72c0/0x6bcd99f6a844283a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265495 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff247e0d expref: 265504 pid: 21356 timeout: 62416 lvb_type: 0
00010000:00000040:20.0:1550079902.133304:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22340
00010000:00000040:20.0:1550079902.133304:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22341
00010000:00000040:5.0:1550079902.133305:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265494
00010000:00010000:20.0:1550079902.133306:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc42d984800/0x6bcd99f6a7d1bbf6 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22341 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bf27be expref: 22341 pid: 21727 timeout: 0 lvb_type: 0
00010000:00000040:5.0:1550079902.133306:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265493
00010000:00000040:5.0:1550079902.133307:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265501
00000020:00000040:5.0:1550079902.133307:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265503
00000001:00000040:5.0:1550079902.133308:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 132
00010000:00000040:20.0:1550079902.133310:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22340
00010000:00000040:20.0:1550079902.133310:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22339
00010000:00000040:20.0:1550079902.133311:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22339
00000020:00000040:20.0:1550079902.133312:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22340
00000001:00000040:20.0:1550079902.133313:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 103
00010000:00000040:5.0:1550079902.134063:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265494
00000004:00000040:5.0:1550079902.134064:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.134065:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265495
00010000:00010000:5.0:1550079902.134066:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d85364a40/0x6bcd99f6a832df1b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265495 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1d7e0d expref: 265503 pid: 20612 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.134070:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265494
00000020:00000040:5.0:1550079902.134071:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d85364a40 with handle 0x6bcd99f6a832df1b from hash
00010000:00000040:5.0:1550079902.134072:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265493
00010000:00000040:5.0:1550079902.134073:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265494
00010000:00010000:5.0:1550079902.134075:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d85364a40/0x6bcd99f6a832df1b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265494 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1d7e0d expref: 265503 pid: 20612 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.134078:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265493
00010000:00000040:5.0:1550079902.134079:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265492
00010000:00000040:5.0:1550079902.134079:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265500
00000020:00000040:5.0:1550079902.134080:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265502
00000001:00000040:5.0:1550079902.134081:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 133
00010000:00000040:20.0:1550079902.134278:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22340
00000004:00000040:20.0:1550079902.134278:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.134280:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4c090f2c0 with handle 0x6bcd99f6a7a06eb0 from hash
00010000:00000040:20.0:1550079902.134281:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22339
00010000:00000040:20.0:1550079902.134282:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22340
00010000:00010000:20.0:1550079902.134284:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4c090f2c0/0x6bcd99f6a7a06eb0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22340 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b827be expref: 22340 pid: 20532 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.134287:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22339
00010000:00000040:20.0:1550079902.134287:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22338
00010000:00000040:20.0:1550079902.134289:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22338
00000020:00000040:20.0:1550079902.134290:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22339
00000001:00000040:20.0:1550079902.134291:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 104
00010000:00000040:5.0:1550079902.134830:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265493
00000004:00000040:5.0:1550079902.134831:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.134832:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265494
00010000:00010000:5.0:1550079902.134833:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a4eb4140/0x6bcd99f6a8215be8 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265494 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff167e0d expref: 265502 pid: 21721 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.134837:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265493
00000020:00000040:5.0:1550079902.134838:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4a4eb4140 with handle 0x6bcd99f6a8215be8 from hash
00010000:00000040:5.0:1550079902.134839:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265492
00010000:00000040:5.0:1550079902.134840:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265493
00010000:00010000:5.0:1550079902.134841:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a4eb4140/0x6bcd99f6a8215be8 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265493 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff167e0d expref: 265502 pid: 21721 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.134844:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265492
00010000:00000040:5.0:1550079902.134845:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265491
00010000:00000040:5.0:1550079902.134846:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265499
00000020:00000040:5.0:1550079902.134847:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265501
00000001:00000040:5.0:1550079902.134848:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 134
00010000:00000040:20.0:1550079902.135255:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22339
00000004:00000040:20.0:1550079902.135256:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.135258:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb428a38b40 with handle 0x6bcd99f6a768f0d1 from hash
00010000:00000040:20.0:1550079902.135259:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22338
00010000:00000040:20.0:1550079902.135260:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22339
00010000:00010000:20.0:1550079902.135261:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb428a38b40/0x6bcd99f6a768f0d1 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22339 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b127be expref: 22339 pid: 20808 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.135265:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22338
00010000:00000040:20.0:1550079902.135266:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22337
00010000:00000040:20.0:1550079902.135266:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22337
00000020:00000040:20.0:1550079902.135267:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22338
00000001:00000040:20.0:1550079902.135268:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 105
00010000:00000040:5.0:1550079902.135603:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265492
00000004:00000040:5.0:1550079902.135604:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.135605:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265493
00010000:00010000:5.0:1550079902.135607:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc43aa660c0/0x6bcd99f6a809ee9a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265493 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0f7e0d expref: 265501 pid: 21721 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.135611:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265492
00000020:00000040:5.0:1550079902.135612:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc43aa660c0 with handle 0x6bcd99f6a809ee9a from hash
00010000:00000040:5.0:1550079902.135613:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265491
00010000:00000040:5.0:1550079902.135614:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265492
00010000:00010000:5.0:1550079902.135615:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc43aa660c0/0x6bcd99f6a809ee9a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265492 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0f7e0d expref: 265501 pid: 21721 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.135619:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265491
00010000:00000040:5.0:1550079902.135619:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265490
00010000:00000040:5.0:1550079902.135620:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265498
00000020:00000040:5.0:1550079902.135621:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265500
00000001:00000040:5.0:1550079902.135622:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 135
00010000:00000040:20.0:1550079902.136231:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22338
00000004:00000040:20.0:1550079902.136232:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.136234:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c94fbcf06c0 with handle 0x6bcd99f6a70a6afe from hash
00010000:00000040:20.0:1550079902.136235:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22337
00010000:00000040:20.0:1550079902.136236:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22338
00010000:00010000:20.0:1550079902.136238:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c94fbcf06c0/0x6bcd99f6a70a6afe lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22338 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a327be expref: 22338 pid: 21845 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.136241:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22337
00010000:00000040:20.0:1550079902.136242:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22336
00010000:00000040:20.0:1550079902.136242:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22336
00000020:00000040:20.0:1550079902.136243:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22337
00000001:00000040:20.0:1550079902.136244:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 106
00010000:00000040:5.0:1550079902.136378:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265491
00000004:00000040:5.0:1550079902.136379:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.136380:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265492
00010000:00010000:5.0:1550079902.136381:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd458ff1d40/0x6bcd99f6a7edf2c2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265492 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff087e0d expref: 265500 pid: 21725 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.136385:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265491
00000020:00000040:5.0:1550079902.136387:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd458ff1d40 with handle 0x6bcd99f6a7edf2c2 from hash
00010000:00000040:5.0:1550079902.136388:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265490
00010000:00000040:5.0:1550079902.136388:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265491
00010000:00010000:5.0:1550079902.136390:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd458ff1d40/0x6bcd99f6a7edf2c2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265491 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff087e0d expref: 265500 pid: 21725 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.136393:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265490
00010000:00000040:5.0:1550079902.136393:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265489
00010000:00000040:5.0:1550079902.136394:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265497
00000020:00000040:5.0:1550079902.136395:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265499
00000001:00000040:5.0:1550079902.136396:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 136
00010000:00000040:5.0:1550079902.137152:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265490
00000004:00000040:5.0:1550079902.137152:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.137153:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265491
00010000:00010000:5.0:1550079902.137155:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc41475e9c0/0x6bcd99f6a7c04c9d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265491 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff017e0d expref: 265499 pid: 21727 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.137158:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265490
00000020:00000040:5.0:1550079902.137159:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc41475e9c0 with handle 0x6bcd99f6a7c04c9d from hash
00010000:00000040:5.0:1550079902.137160:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265489
00010000:00000040:5.0:1550079902.137161:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265490
00010000:00010000:5.0:1550079902.137162:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc41475e9c0/0x6bcd99f6a7c04c9d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265490 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff017e0d expref: 265499 pid: 21727 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.137165:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265489
00010000:00000040:5.0:1550079902.137165:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265488
00010000:00000040:5.0:1550079902.137166:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265496
00000020:00000040:5.0:1550079902.137167:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265498
00000001:00000040:5.0:1550079902.137168:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 137
00010000:00000040:20.0:1550079902.137208:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22337
00000004:00000040:20.0:1550079902.137210:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.137212:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd391a38d80 with handle 0x6bcd99f6a950cfb1 from hash
00010000:00000040:20.0:1550079902.137213:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22336
00010000:00000040:20.0:1550079902.137214:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22337
00010000:00010000:20.0:1550079902.137216:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd391a38d80/0x6bcd99f6a950cfb1 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22337 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e72fbe expref: 22337 pid: 21453 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.137219:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22336
00010000:00000040:20.0:1550079902.137219:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22335
00010000:00000040:20.0:1550079902.137220:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22335
00000020:00000040:20.0:1550079902.137221:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22336
00000001:00000040:20.0:1550079902.137222:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 107
00000100:00000040:6.0:1550079902.137875:0:20247:0:(events.c:348:request_in_callback()) incoming req@ffff9cc3fcfe5d00 x1625107343525888 msgsize 1768
00000020:00000040:30.0:1550079902.137881:0:21149:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa14353
00000020:00000040:30.0:1550079902.137884:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482dff400 : new refcount 16
00000100:00000040:30.0:1550079902.137887:0:21149:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:30.0:1550079902.137891:0:21149:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482dff400 : new rpc_count 1
00000100:00000040:30.0:1550079902.137893:0:21149:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cc3fcfe5d00 x1625107343525888/t0(0) o101->851587ce-2eac-b0a9-21f9-cc85a8845f20@10.9.114.5@o2ib4:33/0 lens 1768/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:30.0:1550079902.137901:0:21149:0:(ldlm_lockd.c:1194:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000040:30.0:1550079902.137905:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4f7581500 count: 52
00000020:00000040:30.0:1550079902.137908:0:21149:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9ca45312dc40 with handle 0x6bcd99f6a9ded6fa to hash
00010000:00000040:30.0:1550079902.137909:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4f7581500 count: 53
00010000:00010000:30.0:1550079902.137910:0:21149:0:(ldlm_lockd.c:1262:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312dc40/0x6bcd99f6a9ded6fa lrc: 2/0,0 mode: --/CR res: [0x200001798:0x2:0x0].0x0 bits 0x0/0x0 rrc: 53 type: IBT flags: 0x40000000000000 nid: local remote: 0x1528c93c8960654e expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.137915:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4f7581500 count: 52
00010000:00000040:30.0:1550079902.137916:0:21149:0:(ldlm_lockd.c:1289:ldlm_handle_enqueue0()) lock GETting export ffff9ca482dff400 : new locks_count 11
00000020:00000040:30.0:1550079902.137917:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482dff400 : new refcount 17
00010000:00000040:5.0:1550079902.137919:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265489
00000004:00000040:5.0:1550079902.137920:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.137921:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265490
00010000:00010000:5.0:1550079902.137923:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9ec2e64380/0x6bcd99f6a78ff0fa lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265490 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefa7e0d expref: 265498 pid: 21346 timeout: 62421 lvb_type: 0
00000004:00000040:30.0:1550079902.137925:0:21149:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000046de:0x28:0x0]
00010000:00000040:5.0:1550079902.137926:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265489
00000020:00000040:5.0:1550079902.137928:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9ec2e64380 with handle 0x6bcd99f6a78ff0fa from hash
00010000:00000040:5.0:1550079902.137929:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265488
00010000:00000040:5.0:1550079902.137930:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265489
00010000:00010000:5.0:1550079902.137932:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9ec2e64380/0x6bcd99f6a78ff0fa lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265489 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefa7e0d expref: 265498 pid: 21346 timeout: 62421 lvb_type: 0
00010000:00000040:30.0:1550079902.137935:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 4
00010000:00000040:5.0:1550079902.137935:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265488
00000020:00000040:30.0:1550079902.137936:0:21149:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9ca45312da00 with handle 0x6bcd99f6a9ded701 to hash
00010000:00000040:5.0:1550079902.137936:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265487
00010000:00000040:5.0:1550079902.137936:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265495
00010000:00000040:30.0:1550079902.137937:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00000020:00000040:5.0:1550079902.137937:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265497
00010000:00010000:30.0:1550079902.137938:0:21149:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312da00/0x6bcd99f6a9ded701 lrc: 3/1,0 mode: --/CR res: [0x2000046de:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00000001:00000040:5.0:1550079902.137938:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 138
00010000:00000040:30.0:1550079902.137942:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00000040:30.0:1550079902.137945:0:21149:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x2000046de:0x28:0x0].0x0 (ffff9cc46a7aef00) refcount = 4
00010000:00000040:30.0:1550079902.137947:0:21149:0:(ldlm_resource.c:1728:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:30.0:1550079902.137947:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00010000:00000040:30.0:1550079902.137949:0:21149:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9ca3d5dd1680/0x6bcd99f68c3e3e88 lrc: 2/0,0 mode: PW/PW res: [0x2000046de:0x28:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40200000000000 nid: 10.9.114.5@o2ib4 remote: 0x1528c93c895e2223 expref: 17 pid: 21805 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.137953:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00000040:30.0:1550079902.137954:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00010000:00000040:30.0:1550079902.137955:0:21149:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9cb41df75c40/0x6bcd99f68c4fcda7 lrc: 2/0,0 mode: CR/CR res: [0x2000046de:0x28:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT flags: 0x40200000000000 nid: 10.9.114.5@o2ib4 remote: 0x1528c93c895e3069 expref: 17 pid: 21736 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.137958:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00000040:30.0:1550079902.137960:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00010000:00000040:30.0:1550079902.137961:0:21149:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9c9ee2fc4800/0x6bcd99f68c364234 lrc: 2/0,0 mode: PR/PR res: [0x2000046de:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40200000000000 nid: 10.9.114.5@o2ib4 remote: 0x1528c93c895e1c03 expref: 17 pid: 20820 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.137964:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00000040:30.0:1550079902.137965:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00010000:00010000:30.0:1550079902.137965:0:21149:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312da00/0x6bcd99f6a9ded701 lrc: 3/1,0 mode: CR/CR res: [0x2000046de:0x28:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.137969:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00000040:30.0:1550079902.137971:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00010000:00010000:30.0:1550079902.137972:0:21149:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312da00/0x6bcd99f6a9ded701 lrc: 3/1,0 mode: CR/CR res: [0x2000046de:0x28:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.137975:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00000020:00000040:30.0:1550079902.137979:0:21149:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cc40c321900 with handle 0x6bcd99f6a9ded708 to hash
00000001:00000040:30.0:1550079902.137983:0:21149:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff9ca482dff400 : new cb_count 1
00000020:00000040:30.0:1550079902.137984:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482dff400 : new refcount 18
00000004:00000040:30.0:1550079902.137990:0:21149:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 728 cookie/acl_size = 0
00000004:00000040:30.0:1550079902.137991:0:21149:0:(mdt_handler.c:3550:mdt_intent_lock_replace()) lock GETting export ffff9ca482dff400 : new locks_count 12
00000020:00000040:30.0:1550079902.137992:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482dff400 : new refcount 19
00000020:00000040:30.0:1550079902.137994:0:21149:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca45312dc40 with handle 0x6bcd99f6a9ded6fa from hash
00010000:00000040:30.0:1550079902.137995:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4f7581500 count: 53
00010000:00010000:30.0:1550079902.137996:0:21149:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312dc40/0x6bcd99f6a9ded6fa lrc: 0/0,0 mode: --/CR res: [0x200001798:0x2:0x0].0x0 bits 0x1/0x0 rrc: 53 type: IBT flags: 0x44000000000000 nid: 10.9.114.5@o2ib4 remote: 0x1528c93c8960654e expref: 19 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.138000:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4f7581500 count: 52
00010000:00000040:30.0:1550079902.138000:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4f7581500 count: 51
00010000:00000040:30.0:1550079902.138001:0:21149:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca482dff400 : new locks_count 11
00000020:00000040:30.0:1550079902.138002:0:21149:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482dff400 : new refcount 18
00010000:00000040:30.0:1550079902.138003:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00010000:00010000:30.0:1550079902.138005:0:21149:0:(ldlm_lockd.c:1410:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply(err=0, rc=0) ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312da00/0x6bcd99f6a9ded701 lrc: 3/0,0 mode: CR/CR res: [0x2000046de:0x28:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT flags: 0x40200000000000 nid: 10.9.114.5@o2ib4 remote: 0x1528c93c8960654e expref: 18 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.138008:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00010000:30.0:1550079902.138009:0:21149:0:(ldlm_lockd.c:1488:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff9ca45312da00, rc 0)
00010000:00000040:30.0:1550079902.138010:0:21149:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597444, transno 38754597598, xid 1625107343525888
00000100:00000040:30.0:1550079902.138013:0:21149:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cd4fa779060 refcount 6 to 10.9.114.5@o2ib4
00000100:00000040:30.0:1550079902.138015:0:21149:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.9.114.5@o2ib4
00000100:00000040:30.0:1550079902.138025:0:21149:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cd4fa779060 refcount 5 to 10.9.114.5@o2ib4
00000100:00000040:30.0:1550079902.138027:0:21149:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cc3fcfe5d00 x1625107343525888/t38754597598(0) o101->851587ce-2eac-b0a9-21f9-cc85a8845f20@10.9.114.5@o2ib4:33/0 lens 1768/1288 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:30.0:1550079902.138031:0:21149:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482dff400 : new rpc_count 0
00000020:00000040:30.0:1550079902.138033:0:21149:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482dff400 : new refcount 17
00010000:00000040:20.0:1550079902.138187:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22336
00000004:00000040:20.0:1550079902.138188:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.138190:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d888698c0 with handle 0x6bcd99f6a90966eb from hash
00010000:00000040:20.0:1550079902.138191:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22335
00010000:00000040:20.0:1550079902.138192:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22336
00010000:00010000:20.0:1550079902.138193:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d888698c0/0x6bcd99f6a90966eb lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22336 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e02fbe expref: 22336 pid: 20526 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.138197:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22335
00010000:00000040:20.0:1550079902.138197:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22334
00010000:00000040:20.0:1550079902.138198:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22334
00000020:00000040:20.0:1550079902.138199:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22335
00000001:00000040:20.0:1550079902.138200:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 108
00000100:00000040:24.0F:1550079902.138585:0:20236:0:(events.c:348:request_in_callback()) incoming req@ffff9c9e318ea100 x1625107343525904 msgsize 328
00000020:00000040:28.0:1550079902.138598:0:22989:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa14353
00000020:00000040:28.0:1550079902.138601:0:22989:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482dff400 : new refcount 18
00000100:00000040:28.0:1550079902.138608:0:22989:0:(service.c:1210:ptlrpc_at_set_timer()) armed ldlm_canceld at +38s
00000100:00000040:28.0:1550079902.138619:0:22989:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482dff400 : new rpc_count 1
00000100:00000040:28.0:1550079902.138622:0:22989:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9c9e318ea100 x1625107343525904/t0(0) o103->851587ce-2eac-b0a9-21f9-cc85a8845f20@10.9.114.5@o2ib4:15/0 lens 328/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:28.0:1550079902.138632:0:22989:0:(ldlm_lockd.c:1628:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000040:28.0:1550079902.138633:0:22989:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 5
00000020:00000040:28.0:1550079902.138637:0:22989:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca45312da00 with handle 0x6bcd99f6a9ded701 from hash
00010000:00000040:28.0:1550079902.138639:0:22989:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc46a7aef00 count: 6
00010000:00010000:28.0:1550079902.138641:0:22989:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312da00/0x6bcd99f6a9ded701 lrc: 0/0,0 mode: --/CR res: [0x2000046de:0x28:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT flags: 0x44a01000000000 nid: 10.9.114.5@o2ib4 remote: 0x1528c93c8960654e expref: 18 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:28.0:1550079902.138645:0:22989:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 5
00010000:00000040:28.0:1550079902.138646:0:22989:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 4
00010000:00000040:28.0:1550079902.138647:0:22989:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca482dff400 : new locks_count 10
00000020:00000040:28.0:1550079902.138648:0:22989:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482dff400 : new refcount 17
00010000:00000040:28.0:1550079902.138649:0:22989:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc46a7aef00 count: 3
00010000:00010000:28.0:1550079902.138650:0:22989:0:(ldlm_lockd.c:1678:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00000040:28.0:1550079902.138653:0:22989:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cd4fa779060 refcount 6 to 10.9.114.5@o2ib4
00000100:00000040:28.0:1550079902.138656:0:22989:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.9.114.5@o2ib4
00000100:00000040:28.0:1550079902.138674:0:22989:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cd4fa779060 refcount 5 to 10.9.114.5@o2ib4
00000100:00000040:28.0:1550079902.138676:0:22989:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9c9e318ea100 x1625107343525904/t0(0) o103->851587ce-2eac-b0a9-21f9-cc85a8845f20@10.9.114.5@o2ib4:15/0 lens 328/192 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:28.0:1550079902.138681:0:22989:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482dff400 : new rpc_count 0
00000020:00000040:28.0:1550079902.138683:0:22989:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482dff400 : new refcount 16
00010000:00000040:5.0:1550079902.138690:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265488
00000004:00000040:5.0:1550079902.138691:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.138692:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265489
00010000:00010000:5.0:1550079902.138693:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca44c96fbc0/0x6bcd99f6a768ae43 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265489 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef37e0d expref: 265497 pid: 21808 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.138697:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265488
00000020:00000040:5.0:1550079902.138698:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca44c96fbc0 with handle 0x6bcd99f6a768ae43 from hash
00010000:00000040:5.0:1550079902.138699:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265487
00010000:00000040:5.0:1550079902.138700:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265488
00010000:00010000:5.0:1550079902.138702:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca44c96fbc0/0x6bcd99f6a768ae43 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265488 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef37e0d expref: 265497 pid: 21808 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.138705:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265487
00010000:00000040:5.0:1550079902.138705:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265486
00010000:00000040:5.0:1550079902.138706:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265494
00000020:00000040:5.0:1550079902.138707:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265496
00000001:00000040:5.0:1550079902.138708:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 139
00010000:00000040:20.0:1550079902.139164:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22335
00000004:00000040:20.0:1550079902.139165:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.139167:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4392f6780 with handle 0x6bcd99f6a8cc3cee from hash
00010000:00000040:20.0:1550079902.139168:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22334
00010000:00000040:20.0:1550079902.139169:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22335
00010000:00010000:20.0:1550079902.139171:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4392f6780/0x6bcd99f6a8cc3cee lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22335 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d92fbe expref: 22335 pid: 20532 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.139174:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22334
00010000:00000040:20.0:1550079902.139175:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22333
00010000:00000040:20.0:1550079902.139176:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22333
00000020:00000040:20.0:1550079902.139177:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22334
00000001:00000040:20.0:1550079902.139178:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 109
00010000:00000040:5.0:1550079902.139465:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265487
00000004:00000040:5.0:1550079902.139465:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.139466:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265488
00010000:00010000:5.0:1550079902.139468:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb48a9e3f00/0x6bcd99f6a74538b6 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265488 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feec7e0d expref: 265496 pid: 20820 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.139472:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265487
00000020:00000040:5.0:1550079902.139473:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb48a9e3f00 with handle 0x6bcd99f6a74538b6 from hash
00010000:00000040:5.0:1550079902.139474:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265486
00010000:00000040:5.0:1550079902.139475:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265487
00010000:00010000:5.0:1550079902.139476:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb48a9e3f00/0x6bcd99f6a74538b6 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265487 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feec7e0d expref: 265496 pid: 20820 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.139479:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265486
00010000:00000040:5.0:1550079902.139480:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265485
00010000:00000040:5.0:1550079902.139481:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265493
00000020:00000040:5.0:1550079902.139482:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265495
00000001:00000040:5.0:1550079902.139483:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 140
00010000:00000040:20.0:1550079902.140143:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22334
00000004:00000040:20.0:1550079902.140144:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.140146:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46901fbc0 with handle 0x6bcd99f6a88fd371 from hash
00010000:00000040:20.0:1550079902.140147:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22333
00010000:00000040:20.0:1550079902.140148:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22334
00010000:00010000:20.0:1550079902.140149:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46901fbc0/0x6bcd99f6a88fd371 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22334 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d22fbe expref: 22334 pid: 21803 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.140152:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22333
00010000:00000040:20.0:1550079902.140153:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22332
00010000:00000040:20.0:1550079902.140154:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22332
00000020:00000040:20.0:1550079902.140155:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22333
00000001:00000040:20.0:1550079902.140156:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 110
00010000:00000040:5.0:1550079902.140239:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265486
00000004:00000040:5.0:1550079902.140240:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.140241:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265487
00010000:00010000:5.0:1550079902.140242:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb413004140/0x6bcd99f6a71a3bf9 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265487 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee57e0d expref: 265495 pid: 20527 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.140245:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265486
00000020:00000040:5.0:1550079902.140247:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb413004140 with handle 0x6bcd99f6a71a3bf9 from hash
00010000:00000040:5.0:1550079902.140248:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265485
00010000:00000040:5.0:1550079902.140248:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265486
00010000:00010000:5.0:1550079902.140250:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb413004140/0x6bcd99f6a71a3bf9 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265486 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee57e0d expref: 265495 pid: 20527 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.140253:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265485
00010000:00000040:5.0:1550079902.140254:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265484
00010000:00000040:5.0:1550079902.140254:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265492
00000020:00000040:5.0:1550079902.140256:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265494
00000001:00000040:5.0:1550079902.140257:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 141
00010000:00000040:5.0:1550079902.141014:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265485
00000004:00000040:5.0:1550079902.141015:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.141016:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265486
00010000:00010000:5.0:1550079902.141017:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fb3be0c0/0x6bcd99f6a6f93733 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265486 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fede7e0d expref: 265494 pid: 21843 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.141020:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265485
00000020:00000040:5.0:1550079902.141022:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3fb3be0c0 with handle 0x6bcd99f6a6f93733 from hash
00010000:00000040:5.0:1550079902.141023:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265484
00010000:00000040:5.0:1550079902.141024:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265485
00010000:00010000:5.0:1550079902.141025:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fb3be0c0/0x6bcd99f6a6f93733 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265485 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fede7e0d expref: 265494 pid: 21843 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.141028:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265484
00010000:00000040:5.0:1550079902.141029:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265483
00010000:00000040:5.0:1550079902.141029:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265491
00000020:00000040:5.0:1550079902.141030:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265493
00000001:00000040:5.0:1550079902.141031:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 142
00010000:00000040:20.0:1550079902.141121:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22333
00000004:00000040:20.0:1550079902.141122:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.141124:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd479ea06c0 with handle 0x6bcd99f6a8441cb0 from hash
00010000:00000040:20.0:1550079902.141125:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22332
00010000:00000040:20.0:1550079902.141126:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22333
00010000:00010000:20.0:1550079902.141128:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd479ea06c0/0x6bcd99f6a8441cb0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22333 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cb2fbe expref: 22333 pid: 21793 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.141131:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22332
00010000:00000040:20.0:1550079902.141132:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22331
00010000:00000040:20.0:1550079902.141133:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22331
00000020:00000040:20.0:1550079902.141134:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22332
00000001:00000040:20.0:1550079902.141135:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 111
00010000:00000040:5.0:1550079902.141778:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265484
00000004:00000040:5.0:1550079902.141779:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.141780:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265485
00010000:00010000:5.0:1550079902.141782:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca35eb433c0/0x6bcd99f6a6cc47d2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265485 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed77e0d expref: 265493 pid: 21811 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.141785:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265484
00000020:00000040:5.0:1550079902.141786:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca35eb433c0 with handle 0x6bcd99f6a6cc47d2 from hash
00010000:00000040:5.0:1550079902.141787:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265483
00010000:00000040:5.0:1550079902.141788:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265484
00010000:00010000:5.0:1550079902.141790:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca35eb433c0/0x6bcd99f6a6cc47d2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265484 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed77e0d expref: 265493 pid: 21811 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.141793:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265483
00010000:00000040:5.0:1550079902.141794:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265482
00010000:00000040:5.0:1550079902.141794:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265490
00000020:00000040:5.0:1550079902.141795:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265492
00000001:00000040:5.0:1550079902.141796:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 143
00010000:00000040:20.0:1550079902.142099:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22332
00000004:00000040:20.0:1550079902.142100:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.142102:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb48d66c5c0 with handle 0x6bcd99f6a8115229 from hash
00010000:00000040:20.0:1550079902.142103:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22331
00010000:00000040:20.0:1550079902.142104:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22332
00010000:00010000:20.0:1550079902.142105:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb48d66c5c0/0x6bcd99f6a8115229 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22332 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c42fbe expref: 22332 pid: 21736 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.142109:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22331
00010000:00000040:20.0:1550079902.142109:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22330
00010000:00000040:20.0:1550079902.142110:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22330
00000020:00000040:20.0:1550079902.142111:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22331
00000001:00000040:20.0:1550079902.142112:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 112
00010000:00000040:5.0:1550079902.142552:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265483
00000004:00000040:5.0:1550079902.142553:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.142554:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265484
00010000:00010000:5.0:1550079902.142556:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a4063cc0/0x6bcd99f6a6ab47e3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265484 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed07e0d expref: 265492 pid: 21811 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.142559:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265483
00000020:00000040:5.0:1550079902.142561:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4a4063cc0 with handle 0x6bcd99f6a6ab47e3 from hash
00010000:00000040:5.0:1550079902.142562:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265482
00010000:00000040:5.0:1550079902.142563:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265483
00010000:00010000:5.0:1550079902.142564:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a4063cc0/0x6bcd99f6a6ab47e3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265483 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed07e0d expref: 265492 pid: 21811 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.142567:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265482
00010000:00000040:5.0:1550079902.142568:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265481
00010000:00000040:5.0:1550079902.142568:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265489
00000020:00000040:5.0:1550079902.142569:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265491
00000001:00000040:5.0:1550079902.142570:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 144
00010000:00000040:20.0:1550079902.143076:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22331
00000004:00000040:20.0:1550079902.143077:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.143078:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca2b9eed7c0 with handle 0x6bcd99f6a7bffd12 from hash
00010000:00000040:20.0:1550079902.143080:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22330
00010000:00000040:20.0:1550079902.143081:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22331
00010000:00010000:20.0:1550079902.143082:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca2b9eed7c0/0x6bcd99f6a7bffd12 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22331 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bd2fbe expref: 22331 pid: 21449 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.143085:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22330
00010000:00000040:20.0:1550079902.143086:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22329
00010000:00000040:20.0:1550079902.143087:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22329
00000020:00000040:20.0:1550079902.143087:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22330
00000001:00000040:20.0:1550079902.143089:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 113
00010000:00000040:5.0:1550079902.143326:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265482
00000004:00000040:5.0:1550079902.143327:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.143327:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265483
00010000:00010000:5.0:1550079902.143329:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4135b4ec0/0x6bcd99f6a8a0f982 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265483 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3e860d expref: 265491 pid: 21767 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.143333:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265482
00000020:00000040:5.0:1550079902.143335:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4135b4ec0 with handle 0x6bcd99f6a8a0f982 from hash
00010000:00000040:5.0:1550079902.143336:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265481
00010000:00000040:5.0:1550079902.143337:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265482
00010000:00010000:5.0:1550079902.143338:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4135b4ec0/0x6bcd99f6a8a0f982 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265482 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3e860d expref: 265491 pid: 21767 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.143341:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265481
00010000:00000040:5.0:1550079902.143342:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265480
00010000:00000040:5.0:1550079902.143342:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265488
00000020:00000040:5.0:1550079902.143343:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265490
00000001:00000040:5.0:1550079902.143344:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 145
00000100:00000040:9.0:1550079902.143507:0:20242:0:(events.c:348:request_in_callback()) incoming req@ffff9cb3c525f500 x1625285162576544 msgsize 600
00000020:00000040:1.0:1550079902.143512:0:20811:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:1.0:1550079902.143514:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40335
00000100:00000040:1.0:1550079902.143517:0:20811:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +21s
00000100:00000040:1.0:1550079902.143520:0:20811:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:1.0:1550079902.143522:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb3c525f500 x1625285162576544/t0(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:753/0 lens 600/0 e 0 to 0 dl 1550079928 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:1.0:1550079902.143528:0:20811:0:(ldlm_lockd.c:1194:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000040:1.0:1550079902.143532:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 2
00000020:00000040:1.0:1550079902.143534:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb33765e780 with handle 0x6bcd99f6a9ded70f to hash
00010000:00000040:1.0:1550079902.143535:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:1.0:1550079902.143536:0:20811:0:(ldlm_lockd.c:1262:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765e780/0x6bcd99f6a9ded70f lrc: 2/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 nid: local remote: 0xe4402ff315162f55 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143541:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:1.0:1550079902.143542:0:20811:0:(ldlm_lockd.c:1289:ldlm_handle_enqueue0()) lock GETting export ffff9ca482e32c00 : new locks_count 40309
00000020:00000040:1.0:1550079902.143543:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40336
00000004:00000040:1.0:1550079902.143545:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x200001855:0x703:0x0]
00010000:00000040:1.0:1550079902.143552:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00000020:00000040:1.0:1550079902.143553:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb337658fc0 with handle 0x6bcd99f6a9ded716 to hash
00010000:00000040:1.0:1550079902.143554:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143555:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 3/1,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143558:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143560:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x200001855:0x703:0x0].0x0 (ffff9cc4fb698780) refcount = 3
00010000:00000040:1.0:1550079902.143561:0:20811:0:(ldlm_resource.c:1728:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:1.0:1550079902.143562:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00000040:1.0:1550079902.143563:0:20811:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9ca479b4b840/0x6bcd99f5afa61a37 lrc: 2/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff314a69bff expref: 40336 pid: 21330 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143567:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143568:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143569:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 3/1,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143572:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143574:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143575:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 3/1,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143578:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00000020:00000040:1.0:1550079902.143581:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb33765a1c0 with handle 0x6bcd99f6a9ded71d to hash
00010000:00000040:1.0:1550079902.143582:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143583:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 3/1,0 mode: --/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143586:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143587:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x200001855:0x703:0x0].0x5493e66d (ffff9cb4aff80000) refcount = 1
00010000:00000040:1.0:1550079902.143588:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143588:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 3/1,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143592:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143592:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143593:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 3/1,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143596:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00000004:00000040:1.0:1550079902.143609:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x6061:0x0]
00000020:00000040:1.0:1550079902.143612:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb33765c380 with handle 0x6bcd99f6a9ded724 to hash
00010000:00000040:1.0:1550079902.143613:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00010000:00010000:1.0:1550079902.143614:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765c380/0x6bcd99f6a9ded724 lrc: 3/1,0 mode: --/PR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143621:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 1
00010000:00000040:1.0:1550079902.143622:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x2000036f0:0x6061:0x0].0x0 (ffff9cb4aff81b00) refcount = 1
00010000:00000040:1.0:1550079902.143623:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00010000:00010000:1.0:1550079902.143624:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765c380/0x6bcd99f6a9ded724 lrc: 3/1,0 mode: PR/PR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143627:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 1
00010000:00000040:1.0:1550079902.143628:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00010000:00010000:1.0:1550079902.143628:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765c380/0x6bcd99f6a9ded724 lrc: 3/1,0 mode: PR/PR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143631:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 1
00000004:00000040:1.0:1550079902.143638:0:20811:0:(mdt_lib.c:655:mdt_dump_lmm()) objid 0x0:6, magic 0x0BD60BD0, pattern 0X278
00010000:00000040:1.0:1550079902.143641:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00000004:00010000:1.0:1550079902.143642:0:20811:0:(mdt_handler.c:1856:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765c380/0x6bcd99f6a9ded724 lrc: 3/1,0 mode: PR/PR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143645:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 1
00010000:00000040:1.0:1550079902.143647:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00000004:00000040:1.0:1550079902.143648:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x6061:0x0]
00000004:00010000:1.0:1550079902.143649:0:20811:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x6061:0x0] updating lvb size from disk: 0 -> 12128
00000004:00010000:1.0:1550079902.143651:0:20811:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x6061:0x0] updating lvb mtime from disk: 0 -> 1549931694
00000004:00010000:1.0:1550079902.143652:0:20811:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x6061:0x0] updating lvb atime from disk: 0 -> 1550066760
00000004:00010000:1.0:1550079902.143654:0:20811:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x6061:0x0] updating lvb ctime from disk: 0 -> 1549931694
00000004:00010000:1.0:1550079902.143655:0:20811:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x6061:0x0] updating lvb blocks from disk: 18427282363563114435 -> 24
00002000:00010000:1.0:1550079902.143657:0:20811:0:(mdt_io.c:1004:mdt_lvb2body()) size 12128
00010000:00000040:1.0:1550079902.143658:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 1
00010000:00000040:1.0:1550079902.143658:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143659:0:20811:0:(ldlm_lock.c:807:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 3/1,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143663:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143663:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143664:0:20811:0:(ldlm_lock.c:863:ldlm_lock_decref_internal()) ### final decref done on cbpending lock ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 2/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143667:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143668:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143668:0:20811:0:(ldlm_lockd.c:1727:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 3/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143672:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00010000:1.0:1550079902.143673:0:20811:0:(ldlm_lockd.c:1758:ldlm_handle_bl_callback()) Lock ffff9cb337658fc0 already unused, calling callback (ffffffffc18d67d0)
00010000:00000040:1.0:1550079902.143674:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143674:0:20811:0:(ldlm_request.c:347:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 3/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143677:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143678:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143679:0:20811:0:(ldlm_request.c:1278:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 4/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143682:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00000020:00000040:1.0:1550079902.143683:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb337658fc0 with handle 0x6bcd99f6a9ded716 from hash
00010000:00000040:1.0:1550079902.143685:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143685:0:20811:0:(ldlm_lockd.c:1767:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 2/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143688:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143689:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:1.0:1550079902.143690:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9cb337658fc0/0x6bcd99f6a9ded716 lrc: 0/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143693:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:1.0:1550079902.143694:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:1.0:1550079902.143695:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143695:0:20811:0:(ldlm_lock.c:807:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 3/1,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143699:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143699:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143700:0:20811:0:(ldlm_lock.c:863:ldlm_lock_decref_internal()) ### final decref done on cbpending lock ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 2/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143703:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143703:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143704:0:20811:0:(ldlm_lockd.c:1727:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 3/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143707:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00010000:1.0:1550079902.143708:0:20811:0:(ldlm_lockd.c:1758:ldlm_handle_bl_callback()) Lock ffff9cb33765a1c0 already unused, calling callback (ffffffffc18d67d0)
00010000:00000040:1.0:1550079902.143708:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143709:0:20811:0:(ldlm_request.c:347:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 3/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143712:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143713:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143713:0:20811:0:(ldlm_request.c:1278:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 4/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143716:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00000020:00000040:1.0:1550079902.143717:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb33765a1c0 with handle 0x6bcd99f6a9ded71d from hash
00010000:00000040:1.0:1550079902.143718:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143719:0:20811:0:(ldlm_lockd.c:1767:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 2/0,0 mode: --/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143722:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143723:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff80000 count: 2
00010000:00010000:1.0:1550079902.143723:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765a1c0/0x6bcd99f6a9ded71d lrc: 0/0,0 mode: --/PR res: [0x200001855:0x703:0x0].0x5493e66d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143726:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 1
00010000:00000040:1.0:1550079902.143727:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff80000 count: 0
00000004:00000040:1.0:1550079902.143728:0:20811:0:(mdt_handler.c:3550:mdt_intent_lock_replace()) lock GETting export ffff9ca482e32c00 : new locks_count 40310
00000020:00000040:1.0:1550079902.143729:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40337
00000004:00000040:1.0:1550079902.143731:0:20811:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 632 cookie/acl_size = 0
00000020:00000040:1.0:1550079902.143733:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb33765e780 with handle 0x6bcd99f6a9ded70f from hash
00010000:00000040:1.0:1550079902.143734:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:1.0:1550079902.143735:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765e780/0x6bcd99f6a9ded70f lrc: 0/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44000000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f55 expref: 40337 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143738:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:1.0:1550079902.143739:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 1
00010000:00000040:1.0:1550079902.143739:0:20811:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca482e32c00 : new locks_count 40309
00000020:00000040:1.0:1550079902.143740:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40336
00010000:00000040:1.0:1550079902.143742:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00010000:00010000:1.0:1550079902.143743:0:20811:0:(ldlm_lockd.c:1410:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply(err=0, rc=0) ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765c380/0x6bcd99f6a9ded724 lrc: 3/0,0 mode: PR/PR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f55 expref: 40336 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1550079902.143746:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 1
00010000:00010000:1.0:1550079902.143747:0:20811:0:(ldlm_lockd.c:1488:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff9cb33765c380, rc 0)
00010000:00000040:1.0:1550079902.143749:0:20811:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 0, xid 1625285162576544
00000100:00000040:1.0:1550079902.143751:0:20811:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.143754:0:20811:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.143762:0:20811:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.143764:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb3c525f500 x1625285162576544/t0(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:753/0 lens 600/1168 e 0 to 0 dl 1550079928 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:1.0:1550079902.143768:0:20811:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:1.0:1550079902.143770:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40335
00010000:00000040:20.0:1550079902.144054:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22330
00000004:00000040:20.0:1550079902.144055:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.144057:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3287d8900 with handle 0x6bcd99f6a793c0af from hash
00010000:00000040:20.0:1550079902.144058:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22329
00010000:00000040:20.0:1550079902.144059:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22330
00010000:00010000:20.0:1550079902.144061:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3287d8900/0x6bcd99f6a793c0af lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22330 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b62fbe expref: 22330 pid: 21711 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.144064:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22329
00010000:00000040:20.0:1550079902.144064:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22328
00010000:00000040:20.0:1550079902.144065:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22328
00000020:00000040:20.0:1550079902.144066:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22329
00000001:00000040:20.0:1550079902.144067:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 114
00010000:00000040:5.0:1550079902.144100:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265481
00000004:00000040:5.0:1550079902.144101:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.144102:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265482
00010000:00010000:5.0:1550079902.144104:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9edda73180/0x6bcd99f6a88267cf lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265482 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff37860d expref: 265490 pid: 21343 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.144107:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265481
00000020:00000040:5.0:1550079902.144109:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9edda73180 with handle 0x6bcd99f6a88267cf from hash
00010000:00000040:5.0:1550079902.144111:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265480
00010000:00000040:5.0:1550079902.144111:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265481
00010000:00010000:5.0:1550079902.144112:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9edda73180/0x6bcd99f6a88267cf lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265481 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff37860d expref: 265490 pid: 21343 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.144116:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265480
00010000:00000040:5.0:1550079902.144116:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265479
00010000:00000040:5.0:1550079902.144117:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265487
00000020:00000040:5.0:1550079902.144118:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265489
00000001:00000040:5.0:1550079902.144120:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 146
00000100:00000040:22.0:1550079902.144599:0:20244:0:(events.c:348:request_in_callback()) incoming req@ffff9cc2ca326f00 x1625285162576560 msgsize 1768
00000020:00000040:30.0:1550079902.144605:0:21149:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:30.0:1550079902.144606:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40336
00000100:00000040:30.0:1550079902.144609:0:21149:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +21s
00000100:00000040:30.0:1550079902.144613:0:21149:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:30.0:1550079902.144615:0:21149:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cc2ca326f00 x1625285162576560/t0(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:753/0 lens 1768/0 e 0 to 0 dl 1550079928 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:30.0:1550079902.144620:0:21149:0:(ldlm_lockd.c:1194:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000040:30.0:1550079902.144624:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 2
00000020:00000040:30.0:1550079902.144625:0:21149:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9ca45312de80 with handle 0x6bcd99f6a9ded72b to hash
00010000:00000040:30.0:1550079902.144626:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:30.0:1550079902.144627:0:21149:0:(ldlm_lockd.c:1262:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312de80/0x6bcd99f6a9ded72b lrc: 2/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 nid: local remote: 0xe4402ff315162f5c expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144630:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:30.0:1550079902.144631:0:21149:0:(ldlm_lockd.c:1289:ldlm_handle_enqueue0()) lock GETting export ffff9ca482e32c00 : new locks_count 40310
00000020:00000040:30.0:1550079902.144632:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40337
00000004:00000040:30.0:1550079902.144638:0:21149:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x6061:0x0]
00010000:00000040:30.0:1550079902.144649:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 2
00000020:00000040:30.0:1550079902.144650:0:21149:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9ca45312e300 with handle 0x6bcd99f6a9ded732 to hash
00010000:00000040:30.0:1550079902.144652:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 3
00010000:00010000:30.0:1550079902.144652:0:21149:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312e300/0x6bcd99f6a9ded732 lrc: 3/1,0 mode: --/CR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144655:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 2
00010000:00000040:30.0:1550079902.144657:0:21149:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x2000036f0:0x6061:0x0].0x0 (ffff9cb4aff81b00) refcount = 2
00010000:00000040:30.0:1550079902.144658:0:21149:0:(ldlm_resource.c:1728:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:30.0:1550079902.144659:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 3
00010000:00000040:30.0:1550079902.144661:0:21149:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9cb33765c380/0x6bcd99f6a9ded724 lrc: 2/0,0 mode: PR/PR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f55 expref: 40337 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144664:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 2
00010000:00000040:30.0:1550079902.144664:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 3
00010000:00010000:30.0:1550079902.144665:0:21149:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312e300/0x6bcd99f6a9ded732 lrc: 3/1,0 mode: CR/CR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144668:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 2
00010000:00000040:30.0:1550079902.144669:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 3
00010000:00010000:30.0:1550079902.144670:0:21149:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312e300/0x6bcd99f6a9ded732 lrc: 3/1,0 mode: CR/CR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144673:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 2
00000020:00000040:30.0:1550079902.144676:0:21149:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cc40c320d80 with handle 0x6bcd99f6a9ded739 to hash
00000001:00000040:30.0:1550079902.144680:0:21149:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff9ca482e32c00 : new cb_count 22
00000020:00000040:30.0:1550079902.144681:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40338
00000004:00000040:30.0:1550079902.144686:0:21149:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 632 cookie/acl_size = 0
00000004:00000040:30.0:1550079902.144688:0:21149:0:(mdt_handler.c:3550:mdt_intent_lock_replace()) lock GETting export ffff9ca482e32c00 : new locks_count 40311
00000020:00000040:30.0:1550079902.144688:0:21149:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40339
00000020:00000040:30.0:1550079902.144690:0:21149:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca45312de80 with handle 0x6bcd99f6a9ded72b from hash
00010000:00000040:30.0:1550079902.144691:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:30.0:1550079902.144693:0:21149:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312de80/0x6bcd99f6a9ded72b lrc: 0/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44000000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f5c expref: 40339 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144696:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:30.0:1550079902.144697:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 1
00010000:00000040:30.0:1550079902.144698:0:21149:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca482e32c00 : new locks_count 40310
00000020:00000040:30.0:1550079902.144698:0:21149:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40338
00010000:00000040:30.0:1550079902.144700:0:21149:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 3
00010000:00010000:30.0:1550079902.144701:0:21149:0:(ldlm_lockd.c:1410:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply(err=0, rc=0) ns: mdt-fir-MDT0000_UUID lock: ffff9ca45312e300/0x6bcd99f6a9ded732 lrc: 3/0,0 mode: CR/CR res: [0x2000036f0:0x6061:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f5c expref: 40338 pid: 21149 timeout: 0 lvb_type: 0
00010000:00000040:30.0:1550079902.144704:0:21149:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 2
00010000:00010000:30.0:1550079902.144705:0:21149:0:(ldlm_lockd.c:1488:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff9ca45312e300, rc 0)
00010000:00000040:30.0:1550079902.144706:0:21149:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 38754597599, xid 1625285162576560
00000100:00000040:30.0:1550079902.144709:0:21149:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:30.0:1550079902.144711:0:21149:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:30.0:1550079902.144722:0:21149:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:30.0:1550079902.144724:0:21149:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cc2ca326f00 x1625285162576560/t38754597599(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:753/0 lens 1768/1192 e 0 to 0 dl 1550079928 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:30.0:1550079902.144728:0:21149:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:30.0:1550079902.144730:0:21149:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40337
00010000:00000040:5.0:1550079902.144876:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265480
00000004:00000040:5.0:1550079902.144877:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.144878:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265481
00010000:00010000:5.0:1550079902.144879:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc41f245580/0x6bcd99f6a868e474 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265481 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff30860d expref: 265489 pid: 21727 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.144883:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265480
00000020:00000040:5.0:1550079902.144884:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc41f245580 with handle 0x6bcd99f6a868e474 from hash
00010000:00000040:5.0:1550079902.144886:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265479
00010000:00000040:5.0:1550079902.144886:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265480
00010000:00010000:5.0:1550079902.144888:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc41f245580/0x6bcd99f6a868e474 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265480 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff30860d expref: 265489 pid: 21727 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.144891:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265479
00010000:00000040:5.0:1550079902.144891:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265478
00010000:00000040:5.0:1550079902.144892:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265486
00000020:00000040:5.0:1550079902.144893:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265488
00000001:00000040:5.0:1550079902.144894:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 147
00010000:00000040:20.0:1550079902.145030:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22329
00000004:00000040:20.0:1550079902.145031:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.145033:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3db8d0900 with handle 0x6bcd99f6a75a0a3a from hash
00010000:00000040:20.0:1550079902.145035:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22328
00010000:00000040:20.0:1550079902.145036:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22329
00010000:00010000:20.0:1550079902.145037:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3db8d0900/0x6bcd99f6a75a0a3a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22329 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52af2fbe expref: 22329 pid: 21866 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.145040:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22328
00010000:00000040:20.0:1550079902.145041:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22327
00010000:00000040:20.0:1550079902.145042:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22327
00000020:00000040:20.0:1550079902.145042:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22328
00000001:00000040:20.0:1550079902.145043:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 115
00010000:00000040:5.0:1550079902.145642:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265479
00000004:00000040:5.0:1550079902.145643:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.145643:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265480
00010000:00010000:5.0:1550079902.145645:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4813cad00/0x6bcd99f6a8551b37 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265480 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff29860d expref: 265488 pid: 20644 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.145649:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265479
00000020:00000040:5.0:1550079902.145650:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4813cad00 with handle 0x6bcd99f6a8551b37 from hash
00010000:00000040:5.0:1550079902.145651:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265478
00010000:00000040:5.0:1550079902.145652:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265479
00010000:00010000:5.0:1550079902.145654:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4813cad00/0x6bcd99f6a8551b37 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265479 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff29860d expref: 265488 pid: 20644 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.145657:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265478
00010000:00000040:5.0:1550079902.145657:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265477
00010000:00000040:5.0:1550079902.145658:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265485
00000020:00000040:5.0:1550079902.145659:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265487
00000001:00000040:5.0:1550079902.145660:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 148
00000100:00000040:4.0:1550079902.145738:0:20237:0:(events.c:348:request_in_callback()) incoming req@ffff9ca350448c50 x1625285162576592 msgsize 488
00000100:00000040:4.0:1550079902.145740:0:20237:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:12.0:1550079902.145748:0:21569:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:12.0:1550079902.145752:0:21569:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40338
00000100:00000040:12.0:1550079902.145756:0:21569:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt_io at +43s
00000100:00000040:12.0:1550079902.145768:0:21569:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:12.0:1550079902.145770:0:21569:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca350448c50 x1625285162576592/t0(0) o3->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:20/0 lens 488/0 e 0 to 0 dl 1550079950 ref 1 fl New:/0/ffffffff rc 0/-1
00000004:00000040:12.0:1550079902.145784:0:21569:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x6061:0x0]
00010000:00000040:20.0:1550079902.146006:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22328
00000004:00000040:20.0:1550079902.146007:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.146009:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd499414800 with handle 0x6bcd99f6a7311c59 from hash
00010000:00000040:20.0:1550079902.146010:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22327
00010000:00000040:20.0:1550079902.146011:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22328
00010000:00010000:20.0:1550079902.146013:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd499414800/0x6bcd99f6a7311c59 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22328 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a82fbe expref: 22328 pid: 21853 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.146016:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22327
00010000:00000040:20.0:1550079902.146016:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22326
00010000:00000040:20.0:1550079902.146017:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22326
00000020:00000040:20.0:1550079902.146018:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22327
00000001:00000040:20.0:1550079902.146019:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 116
00000001:00000040:12.0:1550079902.146157:0:21569:0:(linux-crypto.c:128:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4715 MB/s
00000020:00000040:12.0:1550079902.146159:0:21569:0:(tgt_handler.c:1735:tgt_checksum_niobuf()) Checksum for algo crc32c
00010000:00000040:12.0:1550079902.146170:0:21569:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4aff81b00 count: 3
00010000:00000040:12.0:1550079902.146172:0:21569:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4aff81b00 count: 2
00010000:00000040:12.0:1550079902.146175:0:21569:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 0, xid 1625285162576592
00000100:00000040:12.0:1550079902.146180:0:21569:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:12.0:1550079902.146182:0:21569:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:12.0:1550079902.146199:0:21569:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:12.0:1550079902.146201:0:21569:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca350448c50 x1625285162576592/t0(0) o3->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:20/0 lens 488/12536 e 0 to 0 dl 1550079950 ref 1 fl Interpret:/0/0 rc 12128/12128
00000100:00000040:12.0:1550079902.146206:0:21569:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:12.0:1550079902.146209:0:21569:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40337
00010000:00000040:5.0:1550079902.146416:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265478
00000004:00000040:5.0:1550079902.146417:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.146417:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265479
00010000:00010000:5.0:1550079902.146419:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc421c1c140/0x6bcd99f6a84001ad lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265479 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff22860d expref: 265487 pid: 21758 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.146422:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265478
00000020:00000040:5.0:1550079902.146424:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc421c1c140 with handle 0x6bcd99f6a84001ad from hash
00010000:00000040:5.0:1550079902.146425:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265477
00010000:00000040:5.0:1550079902.146426:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265478
00010000:00010000:5.0:1550079902.146427:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc421c1c140/0x6bcd99f6a84001ad lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265478 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff22860d expref: 265487 pid: 21758 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.146430:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265477
00010000:00000040:5.0:1550079902.146431:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265476
00010000:00000040:5.0:1550079902.146431:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265484
00000020:00000040:5.0:1550079902.146432:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265486
00000001:00000040:5.0:1550079902.146434:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 149
00010000:00000040:20.0:1550079902.147007:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22327
00000004:00000040:20.0:1550079902.147008:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.147010:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3d5738900 with handle 0x6bcd99f6a702ac53 from hash
00010000:00000040:20.0:1550079902.147012:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22326
00010000:00000040:20.0:1550079902.147013:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22327
00010000:00010000:20.0:1550079902.147014:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3d5738900/0x6bcd99f6a702ac53 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22327 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a12fbe expref: 22327 pid: 21816 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.147017:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22326
00010000:00000040:20.0:1550079902.147018:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22325
00010000:00000040:20.0:1550079902.147019:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22325
00000020:00000040:20.0:1550079902.147020:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22326
00000001:00000040:20.0:1550079902.147025:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 117
00010000:00000040:5.0:1550079902.147190:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265477
00000004:00000040:5.0:1550079902.147191:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.147192:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265478
00010000:00010000:5.0:1550079902.147194:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3eeaad100/0x6bcd99f6a82d3351 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265478 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1b860d expref: 265486 pid: 20811 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.147198:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265477
00000020:00000040:5.0:1550079902.147199:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3eeaad100 with handle 0x6bcd99f6a82d3351 from hash
00010000:00000040:5.0:1550079902.147200:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265476
00010000:00000040:5.0:1550079902.147201:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265477
00010000:00010000:5.0:1550079902.147202:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3eeaad100/0x6bcd99f6a82d3351 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265477 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1b860d expref: 265486 pid: 20811 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.147205:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265476
00010000:00000040:5.0:1550079902.147206:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265475
00010000:00000040:5.0:1550079902.147207:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265483
00000020:00000040:5.0:1550079902.147207:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265485
00000001:00000040:5.0:1550079902.147208:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 150
00010000:00000040:5.0:1550079902.147965:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265476
00000004:00000040:5.0:1550079902.147966:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.147967:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265477
00010000:00010000:5.0:1550079902.147968:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3ca79e540/0x6bcd99f6a819baa9 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265477 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff14860d expref: 265485 pid: 20645 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.147971:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265476
00000020:00000040:5.0:1550079902.147972:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3ca79e540 with handle 0x6bcd99f6a819baa9 from hash
00010000:00000040:5.0:1550079902.147973:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265475
00010000:00000040:5.0:1550079902.147974:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265476
00010000:00010000:5.0:1550079902.147975:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3ca79e540/0x6bcd99f6a819baa9 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265476 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff14860d expref: 265485 pid: 20645 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.147978:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265475
00010000:00000040:5.0:1550079902.147979:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265474
00010000:00000040:5.0:1550079902.147980:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265482
00000020:00000040:5.0:1550079902.147981:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265484
00000001:00000040:5.0:1550079902.147982:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 151
00010000:00000040:20.0:1550079902.147990:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22326
00000004:00000040:20.0:1550079902.147991:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.147993:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc43ae99440 with handle 0x6bcd99f6a981d37e from hash
00010000:00000040:20.0:1550079902.147994:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22325
00010000:00000040:20.0:1550079902.147995:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22326
00010000:00010000:20.0:1550079902.147997:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc43ae99440/0x6bcd99f6a981d37e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22326 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ec37be expref: 22326 pid: 21855 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.148004:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22325
00010000:00000040:20.0:1550079902.148005:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22324
00010000:00000040:20.0:1550079902.148005:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22324
00000020:00000040:20.0:1550079902.148006:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22325
00000001:00000040:20.0:1550079902.148007:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 118
00000100:00000040:17.0:1550079902.148611:0:20243:0:(events.c:348:request_in_callback()) incoming req@ffff9cb4fa902050 x1625285162576608 msgsize 392
00000100:00000040:17.0:1550079902.148613:0:20243:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:1.0:1550079902.148618:0:21962:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:1.0:1550079902.148620:0:21962:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40338
00000100:00000040:1.0:1550079902.148622:0:21962:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt_readpage at +43s
00000100:00000040:1.0:1550079902.148627:0:21962:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:1.0:1550079902.148629:0:21962:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb4fa902050 x1625285162576608/t0(0) o35->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:20/0 lens 392/0 e 0 to 0 dl 1550079950 ref 1 fl New:/0/ffffffff rc 0/-1
00000020:00000040:1.0:1550079902.148639:0:21962:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc40c320d80 with handle 0x6bcd99f6a9ded739 from hash
00000004:00000040:1.0:1550079902.148646:0:21962:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000004:00000040:1.0:1550079902.148650:0:21962:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00000001:00000040:1.0:1550079902.148656:0:21962:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff9ca482e32c00 : new cb_count 23
00000020:00000040:1.0:1550079902.148657:0:21962:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40339
00000004:00000040:1.0:1550079902.148664:0:21962:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00010000:00000040:1.0:1550079902.148665:0:21962:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 38754597600, xid 1625285162576608
00000100:00000040:1.0:1550079902.148668:0:21962:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.148670:0:21962:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.148680:0:21962:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:1.0:1550079902.148681:0:21962:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb4fa902050 x1625285162576608/t38754597600(0) o35->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:20/0 lens 392/424 e 0 to 0 dl 1550079950 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:1.0:1550079902.148685:0:21962:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:1.0:1550079902.148687:0:21962:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40338
00010000:00000040:5.0:1550079902.148729:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265475
00000004:00000040:5.0:1550079902.148730:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.148731:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265476
00010000:00010000:5.0:1550079902.148733:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4753660c0/0x6bcd99f6a8042b61 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265476 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0d860d expref: 265484 pid: 20644 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.148736:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265475
00000020:00000040:5.0:1550079902.148737:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4753660c0 with handle 0x6bcd99f6a8042b61 from hash
00010000:00000040:5.0:1550079902.148738:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265474
00010000:00000040:5.0:1550079902.148739:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265475
00010000:00010000:5.0:1550079902.148740:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4753660c0/0x6bcd99f6a8042b61 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265475 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0d860d expref: 265484 pid: 20644 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.148744:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265474
00010000:00000040:5.0:1550079902.148744:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265473
00010000:00000040:5.0:1550079902.148745:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265481
00000020:00000040:5.0:1550079902.148746:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265483
00000001:00000040:5.0:1550079902.148747:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 152
00010000:00000040:20.0:1550079902.148971:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22325
00000004:00000040:20.0:1550079902.148972:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.148973:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4327dd100 with handle 0x6bcd99f6a8ff6ad3 from hash
00010000:00000040:20.0:1550079902.148975:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22324
00010000:00000040:20.0:1550079902.148975:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22325
00010000:00010000:20.0:1550079902.148977:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4327dd100/0x6bcd99f6a8ff6ad3 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22325 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52de37be expref: 22325 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.148980:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22324
00010000:00000040:20.0:1550079902.148981:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22323
00010000:00000040:20.0:1550079902.148981:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22323
00000020:00000040:20.0:1550079902.148982:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22324
00000001:00000040:20.0:1550079902.148983:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 119
00010000:00000040:5.0:1550079902.149504:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265474
00000004:00000040:5.0:1550079902.149505:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.149506:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265475
00010000:00010000:5.0:1550079902.149508:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f7844c80/0x6bcd99f6a7e3c6ec lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265475 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff06860d expref: 265483 pid: 20822 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.149511:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265474
00000020:00000040:5.0:1550079902.149513:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3f7844c80 with handle 0x6bcd99f6a7e3c6ec from hash
00010000:00000040:5.0:1550079902.149514:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265473
00010000:00000040:5.0:1550079902.149515:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265474
00010000:00010000:5.0:1550079902.149516:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f7844c80/0x6bcd99f6a7e3c6ec lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265474 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff06860d expref: 265483 pid: 20822 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.149519:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265473
00010000:00000040:5.0:1550079902.149520:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265472
00010000:00000040:5.0:1550079902.149521:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265480
00000020:00000040:5.0:1550079902.149522:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265482
00000001:00000040:5.0:1550079902.149523:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 153
00010000:00000040:20.0:1550079902.149946:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22324
00000004:00000040:20.0:1550079902.149947:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.149949:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd47fa55a00 with handle 0x6bcd99f6a8b59d7f from hash
00010000:00000040:20.0:1550079902.149950:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22323
00010000:00000040:20.0:1550079902.149951:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22324
00010000:00010000:20.0:1550079902.149952:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd47fa55a00/0x6bcd99f6a8b59d7f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22324 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d737be expref: 22324 pid: 20610 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.149956:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22323
00010000:00000040:20.0:1550079902.149956:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22322
00010000:00000040:20.0:1550079902.149958:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22322
00000020:00000040:20.0:1550079902.149959:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22323
00000001:00000040:20.0:1550079902.149960:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 120
00010000:00000040:5.0:1550079902.150280:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265473
00000004:00000040:5.0:1550079902.150281:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.150281:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265474
00010000:00010000:5.0:1550079902.150283:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e73ca880/0x6bcd99f6a7b12db2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265474 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feff860d expref: 265482 pid: 21849 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.150286:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265473
00000020:00000040:5.0:1550079902.150288:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e73ca880 with handle 0x6bcd99f6a7b12db2 from hash
00010000:00000040:5.0:1550079902.150289:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265472
00010000:00000040:5.0:1550079902.150290:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265473
00010000:00010000:5.0:1550079902.150291:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e73ca880/0x6bcd99f6a7b12db2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265473 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feff860d expref: 265482 pid: 21849 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.150294:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265472
00010000:00000040:5.0:1550079902.150295:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265471
00010000:00000040:5.0:1550079902.150296:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265479
00000020:00000040:5.0:1550079902.150296:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265481
00000001:00000040:5.0:1550079902.150297:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 154
00010000:00000040:20.0:1550079902.150923:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22323
00000004:00000040:20.0:1550079902.150923:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.150925:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc404ea4ec0 with handle 0x6bcd99f6a87ed6e2 from hash
00010000:00000040:20.0:1550079902.150926:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22322
00010000:00000040:20.0:1550079902.150927:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22323
00010000:00010000:20.0:1550079902.150928:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc404ea4ec0/0x6bcd99f6a87ed6e2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22323 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d037be expref: 22323 pid: 21803 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.150932:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22322
00010000:00000040:20.0:1550079902.150932:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22321
00010000:00000040:20.0:1550079902.150933:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22321
00000020:00000040:20.0:1550079902.150934:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22322
00000001:00000040:20.0:1550079902.150935:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 121
00010000:00000040:5.0:1550079902.151054:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265472
00000004:00000040:5.0:1550079902.151054:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.151055:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265473
00010000:00010000:5.0:1550079902.151057:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd492f63840/0x6bcd99f6a7881847 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265473 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef8860d expref: 265481 pid: 21449 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.151061:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265472
00000020:00000040:5.0:1550079902.151062:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd492f63840 with handle 0x6bcd99f6a7881847 from hash
00010000:00000040:5.0:1550079902.151063:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265471
00010000:00000040:5.0:1550079902.151064:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265472
00010000:00010000:5.0:1550079902.151065:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd492f63840/0x6bcd99f6a7881847 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265472 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef8860d expref: 265481 pid: 21449 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.151068:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265471
00010000:00000040:5.0:1550079902.151069:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265470
00010000:00000040:5.0:1550079902.151070:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265478
00000020:00000040:5.0:1550079902.151071:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265480
00000001:00000040:5.0:1550079902.151072:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 155
00010000:00000040:5.0:1550079902.151824:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265471
00000004:00000040:5.0:1550079902.151824:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.151825:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265472
00010000:00010000:5.0:1550079902.151826:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3ecf16780/0x6bcd99f6a759faf8 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265472 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef1860d expref: 265480 pid: 21455 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.151829:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265471
00000020:00000040:5.0:1550079902.151831:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3ecf16780 with handle 0x6bcd99f6a759faf8 from hash
00010000:00000040:5.0:1550079902.151832:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265470
00010000:00000040:5.0:1550079902.151833:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265471
00010000:00010000:5.0:1550079902.151834:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3ecf16780/0x6bcd99f6a759faf8 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265471 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef1860d expref: 265480 pid: 21455 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.151837:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265470
00010000:00000040:5.0:1550079902.151838:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265469
00010000:00000040:5.0:1550079902.151838:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265477
00000020:00000040:5.0:1550079902.151840:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265479
00000001:00000040:5.0:1550079902.151841:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 156
00010000:00000040:20.0:1550079902.151898:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22322
00000004:00000040:20.0:1550079902.151899:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.151900:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb2dae433c0 with handle 0x6bcd99f6a82f7794 from hash
00010000:00000040:20.0:1550079902.151901:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22321
00010000:00000040:20.0:1550079902.151902:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22322
00010000:00010000:20.0:1550079902.151904:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb2dae433c0/0x6bcd99f6a82f7794 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22322 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c937be expref: 22322 pid: 21248 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.151907:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22321
00010000:00000040:20.0:1550079902.151908:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22320
00010000:00000040:20.0:1550079902.151908:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22320
00000020:00000040:20.0:1550079902.151909:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22321
00000001:00000040:20.0:1550079902.151910:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 122
00010000:00000040:5.0:1550079902.152592:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265470
00000004:00000040:5.0:1550079902.152594:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.152595:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265471
00010000:00010000:5.0:1550079902.152596:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9472d580/0x6bcd99f6a73b93ae lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265471 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feea860d expref: 265479 pid: 21727 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.152600:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265470
00000020:00000040:5.0:1550079902.152601:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d9472d580 with handle 0x6bcd99f6a73b93ae from hash
00010000:00000040:5.0:1550079902.152602:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265469
00010000:00000040:5.0:1550079902.152603:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265470
00010000:00010000:5.0:1550079902.152604:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9472d580/0x6bcd99f6a73b93ae lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265470 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feea860d expref: 265479 pid: 21727 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.152607:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265469
00010000:00000040:5.0:1550079902.152608:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265468
00010000:00000040:5.0:1550079902.152608:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265476
00000020:00000040:5.0:1550079902.152609:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265478
00000001:00000040:5.0:1550079902.152611:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 157
00010000:00000040:20.0:1550079902.152876:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22321
00000004:00000040:20.0:1550079902.152877:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.152879:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd486a44800 with handle 0x6bcd99f6a8002c88 from hash
00010000:00000040:20.0:1550079902.152880:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22320
00010000:00000040:20.0:1550079902.152881:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22321
00010000:00010000:20.0:1550079902.152882:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd486a44800/0x6bcd99f6a8002c88 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22321 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c237be expref: 22321 pid: 20644 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.152886:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22320
00010000:00000040:20.0:1550079902.152886:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22319
00010000:00000040:20.0:1550079902.152887:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22319
00000020:00000040:20.0:1550079902.152888:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22320
00000001:00000040:20.0:1550079902.152889:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 123
00010000:00000040:5.0:1550079902.153366:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265469
00000004:00000040:5.0:1550079902.153367:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.153368:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265470
00010000:00010000:5.0:1550079902.153370:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4853c1b00/0x6bcd99f6a70d99a5 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265470 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee3860d expref: 265478 pid: 21458 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.153373:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265469
00000020:00000040:5.0:1550079902.153375:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4853c1b00 with handle 0x6bcd99f6a70d99a5 from hash
00010000:00000040:5.0:1550079902.153376:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265468
00010000:00000040:5.0:1550079902.153376:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265469
00010000:00010000:5.0:1550079902.153378:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4853c1b00/0x6bcd99f6a70d99a5 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265469 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee3860d expref: 265478 pid: 21458 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.153381:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265468
00010000:00000040:5.0:1550079902.153382:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265467
00010000:00000040:5.0:1550079902.153383:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265475
00000020:00000040:5.0:1550079902.153384:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265477
00000001:00000040:5.0:1550079902.153385:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 158
00010000:00000040:20.0:1550079902.153850:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22320
00000004:00000040:20.0:1550079902.153851:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.153852:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9525eeaac0 with handle 0x6bcd99f6a7b121e2 from hash
00010000:00000040:20.0:1550079902.153853:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22319
00010000:00000040:20.0:1550079902.153854:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22320
00010000:00010000:20.0:1550079902.153856:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9525eeaac0/0x6bcd99f6a7b121e2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22320 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bb37be expref: 22320 pid: 21833 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.153859:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22319
00010000:00000040:20.0:1550079902.153860:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22318
00010000:00000040:20.0:1550079902.153864:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22318
00000020:00000040:20.0:1550079902.153865:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22319
00000001:00000040:20.0:1550079902.153866:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 124
00010000:00000040:5.0:1550079902.154141:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265468
00000004:00000040:5.0:1550079902.154142:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.154143:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265469
00010000:00010000:5.0:1550079902.154144:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc430304140/0x6bcd99f6a6ecf557 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265469 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedc860d expref: 265477 pid: 21855 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.154148:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265468
00000020:00000040:5.0:1550079902.154149:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc430304140 with handle 0x6bcd99f6a6ecf557 from hash
00010000:00000040:5.0:1550079902.154151:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265467
00010000:00000040:5.0:1550079902.154151:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265468
00010000:00010000:5.0:1550079902.154153:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc430304140/0x6bcd99f6a6ecf557 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265468 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedc860d expref: 265477 pid: 21855 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.154156:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265467
00010000:00000040:5.0:1550079902.154156:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265466
00010000:00000040:5.0:1550079902.154157:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265474
00000020:00000040:5.0:1550079902.154158:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265476
00000001:00000040:5.0:1550079902.154159:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 159
00010000:00000040:20.0:1550079902.154826:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22319
00000004:00000040:20.0:1550079902.154827:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.154829:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e6e4ec00 with handle 0x6bcd99f6a77f0bc5 from hash
00010000:00000040:20.0:1550079902.154830:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22318
00010000:00000040:20.0:1550079902.154831:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22319
00010000:00010000:20.0:1550079902.154833:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e6e4ec00/0x6bcd99f6a77f0bc5 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22319 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b437be expref: 22319 pid: 21866 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.154836:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22318
00010000:00000040:20.0:1550079902.154837:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22317
00010000:00000040:20.0:1550079902.154837:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22317
00000020:00000040:20.0:1550079902.154838:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22318
00000001:00000040:20.0:1550079902.154839:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 125
00000020:00000040:23.0:1550079902.154871:0:20918:0:(genops.c:1251:class_import_get()) import ffff9ca48206a000 refcount=3 obd=fir-OST0029-osc-MDT0002
00000020:00000040:19.0:1550079902.154871:0:20720:0:(genops.c:1251:class_import_get()) import ffff9cb4f879e000 refcount=3 obd=fir-OST0015-osc-MDT0000
00000020:00000040:7.0:1550079902.154871:0:20728:0:(genops.c:1251:class_import_get()) import ffff9ca481c07800 refcount=3 obd=fir-OST0017-osc-MDT0000
00000020:00000040:1.0:1550079902.154873:0:20722:0:(genops.c:1251:class_import_get()) import ffff9cb4f8799800 refcount=3 obd=fir-OST0010-osc-MDT0000
00000020:00000040:3.0:1550079902.154875:0:20878:0:(genops.c:1251:class_import_get()) import ffff9ca47d8bc800 refcount=3 obd=fir-OST002e-osc-MDT0002
00000020:00000040:13.0:1550079902.154876:0:20738:0:(genops.c:1251:class_import_get()) import ffff9ca481dde800 refcount=3 obd=fir-OST002d-osc-MDT0000
00000020:00000040:41.0:1550079902.154878:0:20732:0:(genops.c:1251:class_import_get()) import ffff9ca481ce6800 refcount=3 obd=fir-OST0014-osc-MDT0000
00000100:00000040:19.0:1550079902.154878:0:20720:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cd364614b00] to pc [ptlrpcd_03_02:2]  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:3.0:1550079902.154881:0:20878:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cd466295d00] to pc [ptlrpcd_03_03:3]  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:1.0:1550079902.154881:0:20722:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cb3e8d9bf00] to pc [ptlrpcd_01_06:6]  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:23.0:1550079902.154882:0:20918:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cd3f72b9200] to pc [ptlrpcd_03_05:5]  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:7.0:1550079902.154882:0:20728:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cd44e63c800] to pc [ptlrpcd_03_04:4]  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000020:00000040:15.0F:1550079902.154884:0:20746:0:(genops.c:1251:class_import_get()) import ffff9cb4f5c7f800 refcount=3 obd=fir-OST0026-osc-MDT0000
00000100:00000040:41.0:1550079902.154885:0:20732:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cb43e7f8300] to pc [ptlrpcd_01_07:7]  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:13.0:1550079902.154888:0:20738:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cb43e2ec500] to pc [ptlrpcd_01_08:8]  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:15.0:1550079902.154892:0:20746:0:(ptlrpcd.c:299:ptlrpcd_add_req()) @@@ add req [ffff9cd364a55700] to pc [ptlrpcd_03_06:6]  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:17.0:1550079902.154895:0:20330:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:31.0F:1550079902.154896:0:20350:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:27.0:1550079902.154897:0:20353:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:47.0F:1550079902.154898:0:20351:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:45.0:1550079902.154900:0:20331:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:23.0:1550079902.154900:0:20352:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:21.0F:1550079902.154903:0:20332:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:19.0:1550079902.154904:0:20354:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Rpc"  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:/0/ffffffff rc 0/-1
00000100:00000040:17.0:1550079902.154910:0:20330:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079913 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:27.0:1550079902.154911:0:20353:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079915 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:45.0:1550079902.154915:0:20331:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079914 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:31.0:1550079902.154915:0:20350:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079916 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:21.0:1550079902.154915:0:20332:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079909 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00010000:00000040:5.0:1550079902.154915:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265467
00000100:00000040:17.0:1550079902.154916:0:20330:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.103@o2ib7
00000004:00000040:5.0:1550079902.154916:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00000100:00000040:47.0:1550079902.154917:0:20351:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079916 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:27.0:1550079902.154917:0:20353:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.108@o2ib7
00010000:00000040:5.0:1550079902.154917:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265468
00000100:00000040:23.0:1550079902.154918:0:20352:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079911 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:19.0:1550079902.154919:0:20354:0:(niobuf.c:905:ptl_send_rpc()) @@@ send flg=0  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079914 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00010000:00010000:5.0:1550079902.154919:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd47d49d340/0x6bcd99f6a6c18cc2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265468 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed5860d expref: 265476 pid: 20610 timeout: 62425 lvb_type: 0
00000100:00000040:31.0:1550079902.154921:0:20350:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.104@o2ib7
00000100:00000040:45.0:1550079902.154923:0:20331:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.103@o2ib7
00000100:00000040:21.0:1550079902.154923:0:20332:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.108@o2ib7
00010000:00000040:5.0:1550079902.154923:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265467
00000100:00000040:47.0:1550079902.154924:0:20351:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.107@o2ib7
00000100:00000040:23.0:1550079902.154924:0:20352:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.104@o2ib7
00000020:00000040:5.0:1550079902.154924:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd47d49d340 with handle 0x6bcd99f6a6c18cc2 from hash
00000100:00000040:19.0:1550079902.154925:0:20354:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.107@o2ib7
00010000:00000040:5.0:1550079902.154925:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265466
00010000:00000040:5.0:1550079902.154926:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265467
00010000:00010000:5.0:1550079902.154927:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd47d49d340/0x6bcd99f6a6c18cc2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265467 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed5860d expref: 265476 pid: 20610 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.154930:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265466
00010000:00000040:5.0:1550079902.154931:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265465
00010000:00000040:5.0:1550079902.154932:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265473
00000020:00000040:5.0:1550079902.154933:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265475
00000001:00000040:5.0:1550079902.154934:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 160
00000100:00000040:43.0:1550079902.154953:0:20250:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079915 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:3.0:1550079902.154959:0:20249:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079913 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:9.0:1550079902.154966:0:20242:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079916 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:19.0:1550079902.154967:0:20251:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079909 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:33.0:1550079902.154976:0:20241:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079911 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:15.0:1550079902.154977:0:20248:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079914 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:41.0:1550079902.154984:0:20240:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079916 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:17.0:1550079902.154992:0:20243:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 1  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079914 ref 2 fl Rpc:/0/ffffffff rc 0/-1
00000100:00000040:9.0:1550079902.155034:0:20242:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079914 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:3.0:1550079902.155049:0:20249:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079909 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:19.0:1550079902.155052:0:20354:0:(client.c:2729:ptlrpc_free_committed()) fir-OST0026-osc-MDT0000: skip recheck: last_committed 34365381412
00000100:00000040:19.0:1550079902.155055:0:20354:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079914 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:41.0:1550079902.155058:0:20240:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079916 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:43.0:1550079902.155060:0:20250:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079913 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:19.0:1550079902.155062:0:20354:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079914 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:19.0:1550079902.155068:0:20354:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cd364a55700 x1625309532784848/t0(0) o13->fir-OST0026-osc-MDT0000@10.0.10.107@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079914 ref 1 fl Complete:R/0/0 rc 0/0
00000100:00000040:21.0:1550079902.155074:0:20332:0:(client.c:2729:ptlrpc_free_committed()) fir-OST002d-osc-MDT0000: skip recheck: last_committed 34365110665
00000020:00000040:19.0:1550079902.155074:0:20354:0:(genops.c:1264:class_import_put()) import ffff9cb4f5c7f800 refcount=2 obd=fir-OST0026-osc-MDT0000
00000100:00000040:15.0:1550079902.155074:0:20248:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079915 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:21.0:1550079902.155077:0:20332:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079909 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:47.0:1550079902.155079:0:20351:0:(client.c:2729:ptlrpc_free_committed()) fir-OST002e-osc-MDT0002: skip recheck: last_committed 34370916993
00000100:00000040:47.0:1550079902.155082:0:20351:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079916 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:21.0:1550079902.155084:0:20332:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079909 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:3.0:1550079902.155084:0:20249:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079914 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:21.0:1550079902.155089:0:20332:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cb43e2ec500 x1625309532784832/t0(0) o13->fir-OST002d-osc-MDT0000@10.0.10.108@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079909 ref 1 fl Complete:R/0/0 rc 0/0
00000100:00000040:47.0:1550079902.155090:0:20351:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079916 ref 1 fl Interpret:R/0/0 rc 0/0
00000020:00000040:21.0:1550079902.155095:0:20332:0:(genops.c:1264:class_import_put()) import ffff9ca481dde800 refcount=2 obd=fir-OST002d-osc-MDT0000
00000100:00000040:47.0:1550079902.155096:0:20351:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cd466295d00 x1625309532784800/t0(0) o13->fir-OST002e-osc-MDT0002@10.0.10.107@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079916 ref 1 fl Complete:R/0/0 rc 0/0
00000100:00000040:17.0:1550079902.155098:0:20330:0:(client.c:2729:ptlrpc_free_committed()) fir-OST0010-osc-MDT0000: skip recheck: last_committed 34364567716
00000020:00000040:47.0:1550079902.155100:0:20351:0:(genops.c:1264:class_import_put()) import ffff9ca47d8bc800 refcount=2 obd=fir-OST002e-osc-MDT0002
00000100:00000040:27.0:1550079902.155100:0:20353:0:(client.c:2729:ptlrpc_free_committed()) fir-OST0029-osc-MDT0002: skip recheck: last_committed 34365651438
00000100:00000040:17.0:1550079902.155100:0:20330:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079913 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:27.0:1550079902.155102:0:20353:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079915 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:45.0:1550079902.155103:0:20331:0:(client.c:2729:ptlrpc_free_committed()) fir-OST0014-osc-MDT0000: skip recheck: last_committed 34364722799
00000100:00000040:45.0:1550079902.155105:0:20331:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079914 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:27.0:1550079902.155108:0:20353:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079915 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:17.0:1550079902.155109:0:20330:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079913 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:45.0:1550079902.155111:0:20331:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079914 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:27.0:1550079902.155114:0:20353:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cd3f72b9200 x1625309532784768/t0(0) o13->fir-OST0029-osc-MDT0002@10.0.10.108@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079915 ref 1 fl Complete:R/0/0 rc 0/0
00000100:00000040:33.0:1550079902.155115:0:20241:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079916 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:17.0:1550079902.155115:0:20330:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cb3e8d9bf00 x1625309532784784/t0(0) o13->fir-OST0010-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079913 ref 1 fl Complete:R/0/0 rc 0/0
00000100:00000040:45.0:1550079902.155116:0:20331:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cb43e7f8300 x1625309532784816/t0(0) o13->fir-OST0014-osc-MDT0000@10.0.10.103@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079914 ref 1 fl Complete:R/0/0 rc 0/0
00000020:00000040:27.0:1550079902.155118:0:20353:0:(genops.c:1264:class_import_put()) import ffff9ca48206a000 refcount=2 obd=fir-OST0029-osc-MDT0002
00000020:00000040:17.0:1550079902.155120:0:20330:0:(genops.c:1264:class_import_put()) import ffff9cb4f8799800 refcount=2 obd=fir-OST0010-osc-MDT0000
00000020:00000040:45.0:1550079902.155121:0:20331:0:(genops.c:1264:class_import_put()) import ffff9ca481ce6800 refcount=2 obd=fir-OST0014-osc-MDT0000
00000100:00000040:9.0:1550079902.155125:0:20242:0:(events.c:161:reply_in_callback()) @@@ reply in flags=0 mlen=336 offset=192 replen=368  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/368 e 0 to 0 dl 1550079911 ref 1 fl Rpc:R/0/ffffffff rc 0/-1
00000100:00000040:31.0:1550079902.155137:0:20350:0:(client.c:2729:ptlrpc_free_committed()) fir-OST0015-osc-MDT0000: skip recheck: last_committed 34364554489
00000100:00000040:31.0:1550079902.155139:0:20350:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079916 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:23.0:1550079902.155139:0:20352:0:(client.c:2729:ptlrpc_free_committed()) fir-OST0017-osc-MDT0000: skip recheck: last_committed 34364562550
00000100:00000040:23.0:1550079902.155140:0:20352:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Rpc" -> "Interpret"  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079911 ref 1 fl Rpc:R/0/0 rc 0/0
00000100:00000040:31.0:1550079902.155145:0:20350:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079916 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:23.0:1550079902.155145:0:20352:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079911 ref 1 fl Interpret:R/0/0 rc 0/0
00000100:00000040:31.0:1550079902.155151:0:20350:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cd364614b00 x1625309532784736/t0(0) o13->fir-OST0015-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079916 ref 1 fl Complete:R/0/0 rc 0/0
00000100:00000040:23.0:1550079902.155151:0:20352:0:(client.c:2543:__ptlrpc_req_finished()) @@@ refcount now 0  req@ffff9cd44e63c800 x1625309532784752/t0(0) o13->fir-OST0017-osc-MDT0000@10.0.10.104@o2ib7:7/4 lens 224/336 e 0 to 0 dl 1550079911 ref 1 fl Complete:R/0/0 rc 0/0
00000020:00000040:31.0:1550079902.155155:0:20350:0:(genops.c:1264:class_import_put()) import ffff9cb4f879e000 refcount=2 obd=fir-OST0015-osc-MDT0000
00000020:00000040:23.0:1550079902.155155:0:20352:0:(genops.c:1264:class_import_put()) import ffff9ca481c07800 refcount=2 obd=fir-OST0017-osc-MDT0000
00010000:00000040:5.0:1550079902.155685:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265466
00000004:00000040:5.0:1550079902.155686:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.155687:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265467
00010000:00010000:5.0:1550079902.155689:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca060395c40/0x6bcd99f6a69a209e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265467 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fece860d expref: 265475 pid: 20612 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.155692:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265466
00000020:00000040:5.0:1550079902.155694:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca060395c40 with handle 0x6bcd99f6a69a209e from hash
00010000:00000040:5.0:1550079902.155695:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265465
00010000:00000040:5.0:1550079902.155695:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265466
00010000:00010000:5.0:1550079902.155696:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca060395c40/0x6bcd99f6a69a209e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265466 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fece860d expref: 265475 pid: 20612 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.155699:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265465
00010000:00000040:5.0:1550079902.155700:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265464
00010000:00000040:5.0:1550079902.155701:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265472
00000020:00000040:5.0:1550079902.155702:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265474
00000001:00000040:5.0:1550079902.155703:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 161
00010000:00000040:20.0:1550079902.155805:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22318
00000004:00000040:20.0:1550079902.155805:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.155807:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f646fc5c0 with handle 0x6bcd99f6a753424f from hash
00010000:00000040:20.0:1550079902.155808:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22317
00010000:00000040:20.0:1550079902.155809:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22318
00010000:00010000:20.0:1550079902.155811:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f646fc5c0/0x6bcd99f6a753424f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22318 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ad37be expref: 22318 pid: 21811 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.155814:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22317
00010000:00000040:20.0:1550079902.155815:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22316
00010000:00000040:20.0:1550079902.155815:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22316
00000020:00000040:20.0:1550079902.155816:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22317
00000001:00000040:20.0:1550079902.155818:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 126
00010000:00000040:5.0:1550079902.156456:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265465
00000004:00000040:5.0:1550079902.156456:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.156457:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265466
00010000:00010000:5.0:1550079902.156459:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e2b3b60c0/0x6bcd99f6a89abfab lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265466 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3c8e0d expref: 265474 pid: 20527 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.156462:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265465
00000020:00000040:5.0:1550079902.156464:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e2b3b60c0 with handle 0x6bcd99f6a89abfab from hash
00010000:00000040:5.0:1550079902.156466:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265464
00010000:00000040:5.0:1550079902.156467:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265465
00010000:00010000:5.0:1550079902.156468:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e2b3b60c0/0x6bcd99f6a89abfab lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265465 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3c8e0d expref: 265474 pid: 20527 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.156471:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265464
00010000:00000040:5.0:1550079902.156472:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265463
00010000:00000040:5.0:1550079902.156472:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265471
00000020:00000040:5.0:1550079902.156473:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265473
00000001:00000040:5.0:1550079902.156474:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 162
00010000:00000040:20.0:1550079902.156799:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22317
00000004:00000040:20.0:1550079902.156800:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.156802:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9fdba4bcc0 with handle 0x6bcd99f6a72055a8 from hash
00010000:00000040:20.0:1550079902.156803:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22316
00010000:00000040:20.0:1550079902.156804:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22317
00010000:00010000:20.0:1550079902.156805:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9fdba4bcc0/0x6bcd99f6a72055a8 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22317 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a637be expref: 22317 pid: 21336 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.156808:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22316
00010000:00000040:20.0:1550079902.156810:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22315
00010000:00000040:20.0:1550079902.156810:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22315
00000020:00000040:20.0:1550079902.156811:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22316
00000001:00000040:20.0:1550079902.156812:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 127
00010000:00000040:5.0:1550079902.157231:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265464
00000004:00000040:5.0:1550079902.157232:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.157233:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265465
00010000:00010000:5.0:1550079902.157234:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3bf156540/0x6bcd99f6a87d7259 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265465 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff358e0d expref: 265473 pid: 21456 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.157238:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265464
00000020:00000040:5.0:1550079902.157239:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3bf156540 with handle 0x6bcd99f6a87d7259 from hash
00010000:00000040:5.0:1550079902.157240:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265463
00010000:00000040:5.0:1550079902.157241:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265464
00010000:00010000:5.0:1550079902.157243:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3bf156540/0x6bcd99f6a87d7259 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265464 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff358e0d expref: 265473 pid: 21456 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.157246:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265463
00010000:00000040:5.0:1550079902.157247:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265462
00010000:00000040:5.0:1550079902.157247:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265470
00000020:00000040:5.0:1550079902.157248:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265472
00000001:00000040:5.0:1550079902.157249:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 163
00010000:00000040:20.0:1550079902.157775:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22316
00000004:00000040:20.0:1550079902.157776:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.157778:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca4497ef080 with handle 0x6bcd99f6a9793d7e from hash
00010000:00000040:20.0:1550079902.157779:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22315
00010000:00000040:20.0:1550079902.157780:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22316
00010000:00010000:20.0:1550079902.157782:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca4497ef080/0x6bcd99f6a9793d7e lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22316 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ea3fbe expref: 22316 pid: 20640 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.157785:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22315
00010000:00000040:20.0:1550079902.157786:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22314
00010000:00000040:20.0:1550079902.157786:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22314
00000020:00000040:20.0:1550079902.157787:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22315
00000001:00000040:20.0:1550079902.157788:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 128
00010000:00000040:5.0:1550079902.158005:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265463
00000004:00000040:5.0:1550079902.158006:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.158007:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265464
00010000:00010000:5.0:1550079902.158008:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4622df500/0x6bcd99f6a862dc68 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265464 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2e8e0d expref: 265472 pid: 21794 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.158012:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265463
00000020:00000040:5.0:1550079902.158013:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4622df500 with handle 0x6bcd99f6a862dc68 from hash
00010000:00000040:5.0:1550079902.158014:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265462
00010000:00000040:5.0:1550079902.158015:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265463
00010000:00010000:5.0:1550079902.158016:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4622df500/0x6bcd99f6a862dc68 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265463 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2e8e0d expref: 265472 pid: 21794 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.158019:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265462
00010000:00000040:5.0:1550079902.158020:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265461
00010000:00000040:5.0:1550079902.158021:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265469
00000020:00000040:5.0:1550079902.158022:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265471
00000001:00000040:5.0:1550079902.158023:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 164
00010000:00000040:20.0:1550079902.158751:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22315
00000004:00000040:20.0:1550079902.158752:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.158754:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc43ba0e780 with handle 0x6bcd99f6a924be90 from hash
00010000:00000040:20.0:1550079902.158755:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22314
00010000:00000040:20.0:1550079902.158756:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22315
00010000:00010000:20.0:1550079902.158757:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc43ba0e780/0x6bcd99f6a924be90 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22315 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e33fbe expref: 22315 pid: 21752 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.158761:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22314
00010000:00000040:20.0:1550079902.158761:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22313
00010000:00000040:20.0:1550079902.158762:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22313
00000020:00000040:20.0:1550079902.158763:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22314
00000001:00000040:20.0:1550079902.158764:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 129
00010000:00000040:5.0:1550079902.158775:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265462
00000004:00000040:5.0:1550079902.158776:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.158776:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265463
00010000:00010000:5.0:1550079902.158778:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc415f54ec0/0x6bcd99f6a84be19e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265463 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff278e0d expref: 265471 pid: 21644 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.158783:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265462
00000020:00000040:5.0:1550079902.158784:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc415f54ec0 with handle 0x6bcd99f6a84be19e from hash
00010000:00000040:5.0:1550079902.158785:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265461
00010000:00000040:5.0:1550079902.158786:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265462
00010000:00010000:5.0:1550079902.158787:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc415f54ec0/0x6bcd99f6a84be19e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265462 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff278e0d expref: 265471 pid: 21644 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.158790:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265461
00010000:00000040:5.0:1550079902.158791:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265460
00010000:00000040:5.0:1550079902.158792:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265468
00000020:00000040:5.0:1550079902.158792:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265470
00000001:00000040:5.0:1550079902.158793:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 165
00010000:00000040:5.0:1550079902.159549:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265461
00000004:00000040:5.0:1550079902.159550:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.159551:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265462
00010000:00010000:5.0:1550079902.159553:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca4283960c0/0x6bcd99f6a83a9c68 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265462 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff208e0d expref: 265470 pid: 20616 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.159556:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265461
00000020:00000040:5.0:1550079902.159557:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca4283960c0 with handle 0x6bcd99f6a83a9c68 from hash
00010000:00000040:5.0:1550079902.159558:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265460
00010000:00000040:5.0:1550079902.159559:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265461
00010000:00010000:5.0:1550079902.159560:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca4283960c0/0x6bcd99f6a83a9c68 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265461 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff208e0d expref: 265470 pid: 20616 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.159563:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265460
00010000:00000040:5.0:1550079902.159564:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265459
00010000:00000040:5.0:1550079902.159564:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265467
00000020:00000040:5.0:1550079902.159566:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265469
00000001:00000040:5.0:1550079902.159566:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 166
00010000:00000040:20.0:1550079902.159730:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22314
00000004:00000040:20.0:1550079902.159731:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.159732:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb391f5da00 with handle 0x6bcd99f6a8ef8189 from hash
00010000:00000040:20.0:1550079902.159733:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22313
00010000:00000040:20.0:1550079902.159734:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22314
00010000:00010000:20.0:1550079902.159736:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb391f5da00/0x6bcd99f6a8ef8189 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22314 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52dc3fbe expref: 22314 pid: 20581 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.159739:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22313
00010000:00000040:20.0:1550079902.159740:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22312
00010000:00000040:20.0:1550079902.159740:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22312
00000020:00000040:20.0:1550079902.159741:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22313
00000001:00000040:20.0:1550079902.159742:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 130
00010000:00000040:5.0:1550079902.160318:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265460
00000004:00000040:5.0:1550079902.160319:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.160319:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265461
00010000:00010000:5.0:1550079902.160321:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb426bf7980/0x6bcd99f6a8284e0b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265461 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff198e0d expref: 265469 pid: 21248 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.160324:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265460
00000020:00000040:5.0:1550079902.160326:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb426bf7980 with handle 0x6bcd99f6a8284e0b from hash
00010000:00000040:5.0:1550079902.160327:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265459
00010000:00000040:5.0:1550079902.160327:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265460
00010000:00010000:5.0:1550079902.160329:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb426bf7980/0x6bcd99f6a8284e0b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265460 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff198e0d expref: 265469 pid: 21248 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.160332:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265459
00010000:00000040:5.0:1550079902.160332:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265458
00010000:00000040:5.0:1550079902.160333:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265466
00000020:00000040:5.0:1550079902.160334:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265468
00000001:00000040:5.0:1550079902.160335:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 167
00010000:00000040:20.0:1550079902.160706:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22313
00000004:00000040:20.0:1550079902.160707:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.160709:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb429ca7080 with handle 0x6bcd99f6a8a7058c from hash
00010000:00000040:20.0:1550079902.160710:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22312
00010000:00000040:20.0:1550079902.160711:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22313
00010000:00010000:20.0:1550079902.160712:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb429ca7080/0x6bcd99f6a8a7058c lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22313 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d53fbe expref: 22313 pid: 20610 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.160715:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22312
00010000:00000040:20.0:1550079902.160716:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22311
00010000:00000040:20.0:1550079902.160717:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22311
00000020:00000040:20.0:1550079902.160718:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22312
00000001:00000040:20.0:1550079902.160719:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 131
00010000:00000040:5.0:1550079902.161091:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265459
00000004:00000040:5.0:1550079902.161092:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.161093:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265460
00010000:00010000:5.0:1550079902.161095:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fdc31b00/0x6bcd99f6a814d5be lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265460 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff128e0d expref: 265468 pid: 21346 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.161098:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265459
00000020:00000040:5.0:1550079902.161099:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3fdc31b00 with handle 0x6bcd99f6a814d5be from hash
00010000:00000040:5.0:1550079902.161100:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265458
00010000:00000040:5.0:1550079902.161101:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265459
00010000:00010000:5.0:1550079902.161103:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fdc31b00/0x6bcd99f6a814d5be lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265459 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff128e0d expref: 265468 pid: 21346 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.161106:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265458
00010000:00000040:5.0:1550079902.161107:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265457
00010000:00000040:5.0:1550079902.161108:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265465
00000020:00000040:5.0:1550079902.161108:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265467
00000001:00000040:5.0:1550079902.161110:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 168
00010000:00000040:20.0:1550079902.161683:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22312
00000004:00000040:20.0:1550079902.161683:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.161685:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3ce049440 with handle 0x6bcd99f6a86a225a from hash
00010000:00000040:20.0:1550079902.161687:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22311
00010000:00000040:20.0:1550079902.161688:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22312
00010000:00010000:20.0:1550079902.161690:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3ce049440/0x6bcd99f6a86a225a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22312 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ce3fbe expref: 22312 pid: 21895 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.161693:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22311
00010000:00000040:20.0:1550079902.161694:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22310
00010000:00000040:20.0:1550079902.161694:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22310
00000020:00000040:20.0:1550079902.161695:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22311
00000001:00000040:20.0:1550079902.161696:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 132
00010000:00000040:5.0:1550079902.161866:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265458
00000004:00000040:5.0:1550079902.161867:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.161867:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265459
00010000:00010000:5.0:1550079902.161869:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f1f18fc0/0x6bcd99f6a7fe3052 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265459 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0b8e0d expref: 265467 pid: 21271 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.161872:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265458
00000020:00000040:5.0:1550079902.161874:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f1f18fc0 with handle 0x6bcd99f6a7fe3052 from hash
00010000:00000040:5.0:1550079902.161875:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265457
00010000:00000040:5.0:1550079902.161876:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265458
00010000:00010000:5.0:1550079902.161877:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f1f18fc0/0x6bcd99f6a7fe3052 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265458 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0b8e0d expref: 265467 pid: 21271 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.161880:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265457
00010000:00000040:5.0:1550079902.161881:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265456
00010000:00000040:5.0:1550079902.161882:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265464
00000020:00000040:5.0:1550079902.161882:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265466
00000001:00000040:5.0:1550079902.161883:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 169
00010000:00000040:5.0:1550079902.162635:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265457
00000004:00000040:5.0:1550079902.162636:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.162637:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265458
00010000:00010000:5.0:1550079902.162638:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb353b7d580/0x6bcd99f6a7d6e090 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265458 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff048e0d expref: 265466 pid: 21888 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.162642:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265457
00000020:00000040:5.0:1550079902.162643:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb353b7d580 with handle 0x6bcd99f6a7d6e090 from hash
00010000:00000040:5.0:1550079902.162644:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265456
00010000:00000040:5.0:1550079902.162645:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265457
00010000:00010000:5.0:1550079902.162646:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb353b7d580/0x6bcd99f6a7d6e090 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265457 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff048e0d expref: 265466 pid: 21888 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.162649:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265456
00010000:00000040:5.0:1550079902.162650:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265455
00010000:00000040:5.0:1550079902.162650:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265463
00000020:00000040:5.0:1550079902.162651:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265465
00000001:00000040:5.0:1550079902.162652:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 170
00010000:00000040:20.0:1550079902.162661:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22311
00000004:00000040:20.0:1550079902.162662:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.162664:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3d62df500 with handle 0x6bcd99f6a82006cb from hash
00010000:00000040:20.0:1550079902.162665:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22310
00010000:00000040:20.0:1550079902.162666:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22311
00010000:00010000:20.0:1550079902.162667:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3d62df500/0x6bcd99f6a82006cb lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22311 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c73fbe expref: 22311 pid: 21855 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.162671:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22310
00010000:00000040:20.0:1550079902.162671:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22309
00010000:00000040:20.0:1550079902.162672:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22309
00000020:00000040:20.0:1550079902.162673:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22310
00000001:00000040:20.0:1550079902.162674:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 133
00010000:00000040:5.0:1550079902.163404:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265456
00000004:00000040:5.0:1550079902.163405:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.163406:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265457
00010000:00010000:5.0:1550079902.163407:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d66e1a1c0/0x6bcd99f6a7a0d83c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265457 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefd8e0d expref: 265465 pid: 20612 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.163411:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265456
00000020:00000040:5.0:1550079902.163412:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d66e1a1c0 with handle 0x6bcd99f6a7a0d83c from hash
00010000:00000040:5.0:1550079902.163413:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265455
00010000:00000040:5.0:1550079902.163414:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265456
00010000:00010000:5.0:1550079902.163415:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d66e1a1c0/0x6bcd99f6a7a0d83c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265456 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefd8e0d expref: 265465 pid: 20612 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.163418:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265455
00010000:00000040:5.0:1550079902.163419:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265454
00010000:00000040:5.0:1550079902.163420:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265462
00000020:00000040:5.0:1550079902.163421:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265464
00000001:00000040:5.0:1550079902.163422:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 171
00010000:00000040:20.0:1550079902.163638:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22310
00000004:00000040:20.0:1550079902.163639:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.163641:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca420f31d40 with handle 0x6bcd99f6a7e090a4 from hash
00010000:00000040:20.0:1550079902.163642:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22309
00010000:00000040:20.0:1550079902.163643:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22310
00010000:00010000:20.0:1550079902.163645:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca420f31d40/0x6bcd99f6a7e090a4 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22310 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c03fbe expref: 22310 pid: 21343 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.163651:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22309
00010000:00000040:20.0:1550079902.163652:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22308
00010000:00000040:20.0:1550079902.163653:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22308
00000020:00000040:20.0:1550079902.163653:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22309
00000001:00000040:20.0:1550079902.163655:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 134
00010000:00000040:5.0:1550079902.164178:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265455
00000004:00000040:5.0:1550079902.164179:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.164180:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265456
00010000:00010000:5.0:1550079902.164181:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4610f5a00/0x6bcd99f6a77a318b lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265456 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef68e0d expref: 265464 pid: 21849 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.164185:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265455
00000020:00000040:5.0:1550079902.164186:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4610f5a00 with handle 0x6bcd99f6a77a318b from hash
00010000:00000040:5.0:1550079902.164187:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265454
00010000:00000040:5.0:1550079902.164188:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265455
00010000:00010000:5.0:1550079902.164189:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4610f5a00/0x6bcd99f6a77a318b lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265455 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef68e0d expref: 265464 pid: 21849 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.164192:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265454
00010000:00000040:5.0:1550079902.164193:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265453
00010000:00000040:5.0:1550079902.164193:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265461
00000020:00000040:5.0:1550079902.164194:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265463
00000001:00000040:5.0:1550079902.164195:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 172
00010000:00000040:20.0:1550079902.164618:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22309
00000004:00000040:20.0:1550079902.164619:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.164620:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc421c80240 with handle 0x6bcd99f6a7a4f307 from hash
00010000:00000040:20.0:1550079902.164621:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22308
00010000:00000040:20.0:1550079902.164622:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22309
00010000:00010000:20.0:1550079902.164624:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc421c80240/0x6bcd99f6a7a4f307 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22309 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b93fbe expref: 22309 pid: 21773 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.164627:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22308
00010000:00000040:20.0:1550079902.164627:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22307
00010000:00000040:20.0:1550079902.164628:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22307
00000020:00000040:20.0:1550079902.164629:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22308
00000001:00000040:20.0:1550079902.164630:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 135
00010000:00000040:5.0:1550079902.164952:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265454
00000004:00000040:5.0:1550079902.164953:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.164954:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265455
00010000:00010000:5.0:1550079902.164955:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9c9421c0/0x6bcd99f6a74e5f32 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265455 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feef8e0d expref: 265463 pid: 21346 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.164959:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265454
00000020:00000040:5.0:1550079902.164960:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d9c9421c0 with handle 0x6bcd99f6a74e5f32 from hash
00010000:00000040:5.0:1550079902.164961:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265453
00010000:00000040:5.0:1550079902.164962:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265454
00010000:00010000:5.0:1550079902.164964:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9c9421c0/0x6bcd99f6a74e5f32 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265454 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feef8e0d expref: 265463 pid: 21346 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.164967:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265453
00010000:00000040:5.0:1550079902.164968:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265452
00010000:00000040:5.0:1550079902.164968:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265460
00000020:00000040:5.0:1550079902.164969:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265462
00000001:00000040:5.0:1550079902.164970:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 173
00010000:00000040:20.0:1550079902.165595:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22308
00000004:00000040:20.0:1550079902.165596:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.165598:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4043fba80 with handle 0x6bcd99f6a76f5f2f from hash
00010000:00000040:20.0:1550079902.165599:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22307
00010000:00000040:20.0:1550079902.165600:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22308
00010000:00010000:20.0:1550079902.165602:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4043fba80/0x6bcd99f6a76f5f2f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22308 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b23fbe expref: 22308 pid: 21888 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.165605:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22307
00010000:00000040:20.0:1550079902.165606:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22306
00010000:00000040:20.0:1550079902.165607:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22306
00000020:00000040:20.0:1550079902.165608:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22307
00000001:00000040:20.0:1550079902.165609:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 136
00010000:00000040:5.0:1550079902.165722:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265453
00000004:00000040:5.0:1550079902.165723:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.165724:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265454
00010000:00010000:5.0:1550079902.165725:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca0990406c0/0x6bcd99f6a72f60ff lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265454 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee88e0d expref: 265462 pid: 21341 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.165729:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265453
00000020:00000040:5.0:1550079902.165730:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca0990406c0 with handle 0x6bcd99f6a72f60ff from hash
00010000:00000040:5.0:1550079902.165731:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265452
00010000:00000040:5.0:1550079902.165732:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265453
00010000:00010000:5.0:1550079902.165733:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca0990406c0/0x6bcd99f6a72f60ff lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265453 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee88e0d expref: 265462 pid: 21341 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.165737:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265452
00010000:00000040:5.0:1550079902.165737:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265451
00010000:00000040:5.0:1550079902.165738:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265459
00000020:00000040:5.0:1550079902.165739:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265461
00000001:00000040:5.0:1550079902.165740:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 174
00010000:00000040:5.0:1550079902.166495:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265452
00000004:00000040:5.0:1550079902.166496:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.166497:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265453
00010000:00010000:5.0:1550079902.166498:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb47cee5580/0x6bcd99f6a70676ac lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265453 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee18e0d expref: 265461 pid: 21767 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.166502:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265452
00000020:00000040:5.0:1550079902.166503:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb47cee5580 with handle 0x6bcd99f6a70676ac from hash
00010000:00000040:5.0:1550079902.166504:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265451
00010000:00000040:5.0:1550079902.166505:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265452
00010000:00010000:5.0:1550079902.166506:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb47cee5580/0x6bcd99f6a70676ac lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265452 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee18e0d expref: 265461 pid: 21767 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.166509:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265451
00010000:00000040:5.0:1550079902.166510:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265450
00010000:00000040:5.0:1550079902.166510:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265458
00000020:00000040:5.0:1550079902.166511:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265460
00000001:00000040:5.0:1550079902.166512:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 175
00010000:00000040:20.0:1550079902.166573:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22307
00000004:00000040:20.0:1550079902.166574:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.166576:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e9d5d3f00 with handle 0x6bcd99f6a74c6dc2 from hash
00010000:00000040:20.0:1550079902.166577:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22306
00010000:00000040:20.0:1550079902.166578:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22307
00010000:00010000:20.0:1550079902.166579:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e9d5d3f00/0x6bcd99f6a74c6dc2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22307 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ab3fbe expref: 22307 pid: 21823 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.166582:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22306
00010000:00000040:20.0:1550079902.166583:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22305
00010000:00000040:20.0:1550079902.166584:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22305
00000020:00000040:20.0:1550079902.166585:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22306
00000001:00000040:20.0:1550079902.166586:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 137
00010000:00000040:5.0:1550079902.167263:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265451
00000004:00000040:5.0:1550079902.167264:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.167265:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265452
00010000:00010000:5.0:1550079902.167267:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f2bb60c0/0x6bcd99f6a6e1b41a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265452 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feda8e0d expref: 265460 pid: 20581 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.167270:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265451
00000020:00000040:5.0:1550079902.167271:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f2bb60c0 with handle 0x6bcd99f6a6e1b41a from hash
00010000:00000040:5.0:1550079902.167272:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265450
00010000:00000040:5.0:1550079902.167273:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265451
00010000:00010000:5.0:1550079902.167274:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f2bb60c0/0x6bcd99f6a6e1b41a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265451 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feda8e0d expref: 265460 pid: 20581 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.167277:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265450
00010000:00000040:5.0:1550079902.167278:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265449
00010000:00000040:5.0:1550079902.167279:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265457
00000020:00000040:5.0:1550079902.167280:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265459
00000001:00000040:5.0:1550079902.167281:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 176
00010000:00000040:20.0:1550079902.167550:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22306
00000004:00000040:20.0:1550079902.167551:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.167553:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb33e663a80 with handle 0x6bcd99f6a712ef31 from hash
00010000:00000040:20.0:1550079902.167554:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22305
00010000:00000040:20.0:1550079902.167555:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22306
00010000:00010000:20.0:1550079902.167556:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb33e663a80/0x6bcd99f6a712ef31 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22306 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a43fbe expref: 22306 pid: 21448 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.167559:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22305
00010000:00000040:20.0:1550079902.167560:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22304
00010000:00000040:20.0:1550079902.167561:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22304
00000020:00000040:20.0:1550079902.167562:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22305
00000001:00000040:20.0:1550079902.167563:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 138
00010000:00000040:5.0:1550079902.168037:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265450
00000004:00000040:5.0:1550079902.168038:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.168039:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265451
00010000:00010000:5.0:1550079902.168041:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb431cf8240/0x6bcd99f6a6bafb95 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265451 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed38e0d expref: 265459 pid: 20645 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.168044:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265450
00000020:00000040:5.0:1550079902.168046:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb431cf8240 with handle 0x6bcd99f6a6bafb95 from hash
00010000:00000040:5.0:1550079902.168047:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265449
00010000:00000040:5.0:1550079902.168047:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265450
00010000:00010000:5.0:1550079902.168049:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb431cf8240/0x6bcd99f6a6bafb95 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265450 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed38e0d expref: 265459 pid: 20645 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.168052:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265449
00010000:00000040:5.0:1550079902.168052:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265448
00010000:00000040:5.0:1550079902.168053:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265456
00000020:00000040:5.0:1550079902.168054:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265458
00000001:00000040:5.0:1550079902.168055:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 177
00010000:00000040:20.0:1550079902.168527:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22305
00000004:00000040:20.0:1550079902.168529:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.168530:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9ef46c7980 with handle 0x6bcd99f6a960dcb8 from hash
00010000:00000040:20.0:1550079902.168531:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22304
00010000:00000040:20.0:1550079902.168532:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22305
00010000:00010000:20.0:1550079902.168534:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9ef46c7980/0x6bcd99f6a960dcb8 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22305 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e847be expref: 22305 pid: 21840 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.168537:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22304
00010000:00000040:20.0:1550079902.168538:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22303
00010000:00000040:20.0:1550079902.168539:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22303
00000020:00000040:20.0:1550079902.168539:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22304
00000001:00000040:20.0:1550079902.168540:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 139
00010000:00000040:5.0:1550079902.168807:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265449
00000004:00000040:5.0:1550079902.168808:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.168808:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265450
00010000:00010000:5.0:1550079902.168810:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc414560240/0x6bcd99f6a6893fbb lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265450 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecc8e0d expref: 265458 pid: 21853 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.168814:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265449
00000020:00000040:5.0:1550079902.168815:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc414560240 with handle 0x6bcd99f6a6893fbb from hash
00010000:00000040:5.0:1550079902.168816:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265448
00010000:00000040:5.0:1550079902.168817:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265449
00010000:00010000:5.0:1550079902.168819:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc414560240/0x6bcd99f6a6893fbb lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265449 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecc8e0d expref: 265458 pid: 21853 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.168822:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265448
00010000:00000040:5.0:1550079902.168822:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265447
00010000:00000040:5.0:1550079902.168823:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265455
00000020:00000040:5.0:1550079902.168824:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265457
00000001:00000040:5.0:1550079902.168825:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 178
00010000:00000040:20.0:1550079902.169505:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22304
00000004:00000040:20.0:1550079902.169506:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.169507:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9dd6b77bc0 with handle 0x6bcd99f6a90ed560 from hash
00010000:00000040:20.0:1550079902.169508:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22303
00010000:00000040:20.0:1550079902.169509:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22304
00010000:00010000:20.0:1550079902.169511:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9dd6b77bc0/0x6bcd99f6a90ed560 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22304 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e147be expref: 22304 pid: 20818 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.169514:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22303
00010000:00000040:20.0:1550079902.169515:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22302
00010000:00000040:20.0:1550079902.169516:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22302
00000020:00000040:20.0:1550079902.169516:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22303
00000001:00000040:20.0:1550079902.169517:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 140
00010000:00000040:5.0:1550079902.169581:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265448
00000004:00000040:5.0:1550079902.169582:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.169583:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265449
00010000:00010000:5.0:1550079902.169584:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4056e4ec0/0x6bcd99f6a89087aa lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265449 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3a960d expref: 265457 pid: 21455 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.169588:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265448
00000020:00000040:5.0:1550079902.169589:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4056e4ec0 with handle 0x6bcd99f6a89087aa from hash
00010000:00000040:5.0:1550079902.169590:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265447
00010000:00000040:5.0:1550079902.169591:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265448
00010000:00010000:5.0:1550079902.169592:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4056e4ec0/0x6bcd99f6a89087aa lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265448 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3a960d expref: 265457 pid: 21455 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.169596:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265447
00010000:00000040:5.0:1550079902.169596:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265446
00010000:00000040:5.0:1550079902.169597:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265454
00000020:00000040:5.0:1550079902.169598:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265456
00000001:00000040:5.0:1550079902.169599:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 179
00010000:00000040:5.0:1550079902.170354:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265447
00000004:00000040:5.0:1550079902.170355:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.170356:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265448
00010000:00010000:5.0:1550079902.170357:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb43cc17080/0x6bcd99f6a8748a35 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265448 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff33960d expref: 265456 pid: 20820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.170361:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265447
00000020:00000040:5.0:1550079902.170362:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb43cc17080 with handle 0x6bcd99f6a8748a35 from hash
00010000:00000040:5.0:1550079902.170363:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265446
00010000:00000040:5.0:1550079902.170364:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265447
00010000:00010000:5.0:1550079902.170365:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb43cc17080/0x6bcd99f6a8748a35 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265447 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff33960d expref: 265456 pid: 20820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.170368:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265446
00010000:00000040:5.0:1550079902.170369:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265445
00010000:00000040:5.0:1550079902.170369:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265453
00000020:00000040:5.0:1550079902.170370:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265455
00000001:00000040:5.0:1550079902.170371:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 180
00010000:00000040:20.0:1550079902.170482:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22303
00000004:00000040:20.0:1550079902.170483:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.170484:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3eeea7500 with handle 0x6bcd99f6a8d9c928 from hash
00010000:00000040:20.0:1550079902.170485:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22302
00010000:00000040:20.0:1550079902.170486:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22303
00010000:00010000:20.0:1550079902.170488:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3eeea7500/0x6bcd99f6a8d9c928 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22303 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52da47be expref: 22303 pid: 21816 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.170492:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22302
00010000:00000040:20.0:1550079902.170492:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22301
00010000:00000040:20.0:1550079902.170493:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22301
00000020:00000040:20.0:1550079902.170494:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22302
00000001:00000040:20.0:1550079902.170495:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 141
00010000:00000040:5.0:1550079902.171125:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265446
00000004:00000040:5.0:1550079902.171126:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.171126:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265447
00010000:00010000:5.0:1550079902.171128:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb42d123a80/0x6bcd99f6a85d2f01 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265447 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2c960d expref: 265455 pid: 21884 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.171132:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265446
00000020:00000040:5.0:1550079902.171133:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb42d123a80 with handle 0x6bcd99f6a85d2f01 from hash
00010000:00000040:5.0:1550079902.171134:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265445
00010000:00000040:5.0:1550079902.171135:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265446
00010000:00010000:5.0:1550079902.171136:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb42d123a80/0x6bcd99f6a85d2f01 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265446 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2c960d expref: 265455 pid: 21884 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.171139:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265445
00010000:00000040:5.0:1550079902.171140:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265444
00010000:00000040:5.0:1550079902.171140:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265452
00000020:00000040:5.0:1550079902.171142:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265454
00000001:00000040:5.0:1550079902.171143:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 181
00010000:00000040:20.0:1550079902.171460:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22302
00000004:00000040:20.0:1550079902.171461:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.171463:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3e3730240 with handle 0x6bcd99f6a89632b7 from hash
00010000:00000040:20.0:1550079902.171464:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22301
00010000:00000040:20.0:1550079902.171465:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22302
00010000:00010000:20.0:1550079902.171467:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e3730240/0x6bcd99f6a89632b7 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22302 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d347be expref: 22302 pid: 21884 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.171470:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22301
00010000:00000040:20.0:1550079902.171471:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22300
00010000:00000040:20.0:1550079902.171471:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22300
00000020:00000040:20.0:1550079902.171472:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22301
00000001:00000040:20.0:1550079902.171473:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 142
00010000:00000040:5.0:1550079902.171899:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265445
00000004:00000040:5.0:1550079902.171900:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.171901:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265446
00010000:00010000:5.0:1550079902.171902:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d432bd100/0x6bcd99f6a846f4e1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265446 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff25960d expref: 265454 pid: 20616 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.171906:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265445
00000020:00000040:5.0:1550079902.171907:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d432bd100 with handle 0x6bcd99f6a846f4e1 from hash
00010000:00000040:5.0:1550079902.171908:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265444
00010000:00000040:5.0:1550079902.171909:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265445
00010000:00010000:5.0:1550079902.171910:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d432bd100/0x6bcd99f6a846f4e1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265445 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff25960d expref: 265454 pid: 20616 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.171913:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265444
00010000:00000040:5.0:1550079902.171914:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265443
00010000:00000040:5.0:1550079902.171915:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265451
00000020:00000040:5.0:1550079902.171916:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265453
00000001:00000040:5.0:1550079902.171917:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 182
00010000:00000040:20.0:1550079902.172437:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22301
00000004:00000040:20.0:1550079902.172438:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.172439:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46770da00 with handle 0x6bcd99f6a851080d from hash
00010000:00000040:20.0:1550079902.172440:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22300
00010000:00000040:20.0:1550079902.172441:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22301
00010000:00010000:20.0:1550079902.172443:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46770da00/0x6bcd99f6a851080d lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22301 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cc47be expref: 22301 pid: 21449 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.172446:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22300
00010000:00000040:20.0:1550079902.172447:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22299
00010000:00000040:20.0:1550079902.172448:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22299
00000020:00000040:20.0:1550079902.172448:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22300
00000001:00000040:20.0:1550079902.172449:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 143
00010000:00000040:5.0:1550079902.172668:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265444
00000004:00000040:5.0:1550079902.172669:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.172670:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265445
00010000:00010000:5.0:1550079902.172672:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc405100900/0x6bcd99f6a836d630 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265445 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1e960d expref: 265453 pid: 21866 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.172675:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265444
00000020:00000040:5.0:1550079902.172676:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc405100900 with handle 0x6bcd99f6a836d630 from hash
00010000:00000040:5.0:1550079902.172678:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265443
00010000:00000040:5.0:1550079902.172678:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265444
00010000:00010000:5.0:1550079902.172680:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc405100900/0x6bcd99f6a836d630 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265444 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1e960d expref: 265453 pid: 21866 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.172683:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265443
00010000:00000040:5.0:1550079902.172684:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265442
00010000:00000040:5.0:1550079902.172685:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265450
00000020:00000040:5.0:1550079902.172685:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265452
00000001:00000040:5.0:1550079902.172686:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 183
00010000:00000040:20.0:1550079902.173415:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22300
00000004:00000040:20.0:1550079902.173415:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.173417:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e62f9b00 with handle 0x6bcd99f6a816172b from hash
00010000:00000040:20.0:1550079902.173419:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22299
00010000:00000040:20.0:1550079902.173420:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22300
00010000:00010000:20.0:1550079902.173421:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e62f9b00/0x6bcd99f6a816172b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22300 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c547be expref: 22300 pid: 21758 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.173425:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22299
00010000:00000040:20.0:1550079902.173425:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22298
00010000:00000040:20.0:1550079902.173426:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22298
00000020:00000040:20.0:1550079902.173427:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22299
00000001:00000040:20.0:1550079902.173428:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 144
00010000:00000040:5.0:1550079902.173443:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265443
00000004:00000040:5.0:1550079902.173444:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.173445:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265444
00010000:00010000:5.0:1550079902.173446:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d5a12b3c0/0x6bcd99f6a8235045 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265444 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff17960d expref: 265452 pid: 21318 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.173450:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265443
00000020:00000040:5.0:1550079902.173451:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d5a12b3c0 with handle 0x6bcd99f6a8235045 from hash
00010000:00000040:5.0:1550079902.173452:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265442
00010000:00000040:5.0:1550079902.173453:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265443
00010000:00010000:5.0:1550079902.173454:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d5a12b3c0/0x6bcd99f6a8235045 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265443 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff17960d expref: 265452 pid: 21318 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.173457:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265442
00010000:00000040:5.0:1550079902.173458:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265441
00010000:00000040:5.0:1550079902.173459:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265449
00000020:00000040:5.0:1550079902.173459:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265451
00000001:00000040:5.0:1550079902.173461:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 184
00010000:00000040:5.0:1550079902.174217:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265442
00000004:00000040:5.0:1550079902.174218:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.174219:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265443
00010000:00010000:5.0:1550079902.174220:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd473f11b00/0x6bcd99f6a80bc075 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265443 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff10960d expref: 265451 pid: 21793 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.174224:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265442
00000020:00000040:5.0:1550079902.174225:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd473f11b00 with handle 0x6bcd99f6a80bc075 from hash
00010000:00000040:5.0:1550079902.174226:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265441
00010000:00000040:5.0:1550079902.174226:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265442
00010000:00010000:5.0:1550079902.174228:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd473f11b00/0x6bcd99f6a80bc075 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265442 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff10960d expref: 265451 pid: 21793 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.174231:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265441
00010000:00000040:5.0:1550079902.174231:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265440
00010000:00000040:5.0:1550079902.174232:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265448
00000020:00000040:5.0:1550079902.174233:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265450
00000001:00000040:5.0:1550079902.174233:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 185
00010000:00000040:20.0:1550079902.174394:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22299
00000004:00000040:20.0:1550079902.174395:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.174396:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4080c21c0 with handle 0x6bcd99f6a7c7118d from hash
00010000:00000040:20.0:1550079902.174398:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22298
00010000:00000040:20.0:1550079902.174398:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22299
00010000:00010000:20.0:1550079902.174400:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4080c21c0/0x6bcd99f6a7c7118d lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22299 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52be47be expref: 22299 pid: 21866 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.174403:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22298
00010000:00000040:20.0:1550079902.174404:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22297
00010000:00000040:20.0:1550079902.174404:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22297
00000020:00000040:20.0:1550079902.174405:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22298
00000001:00000040:20.0:1550079902.174406:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 145
00010000:00000040:5.0:1550079902.174985:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265441
00000004:00000040:5.0:1550079902.174986:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.174986:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265442
00010000:00010000:5.0:1550079902.174988:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e2e02880/0x6bcd99f6a7f3d7ff lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265442 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff09960d expref: 265450 pid: 20822 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.174992:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265441
00000020:00000040:5.0:1550079902.174993:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3e2e02880 with handle 0x6bcd99f6a7f3d7ff from hash
00010000:00000040:5.0:1550079902.174994:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265440
00010000:00000040:5.0:1550079902.174995:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265441
00010000:00010000:5.0:1550079902.174996:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e2e02880/0x6bcd99f6a7f3d7ff lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265441 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff09960d expref: 265450 pid: 20822 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.174999:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265440
00010000:00000040:5.0:1550079902.175000:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265439
00010000:00000040:5.0:1550079902.175001:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265447
00000020:00000040:5.0:1550079902.175002:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265449
00000001:00000040:5.0:1550079902.175003:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 186
00010000:00000040:20.0:1550079902.175372:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22298
00000004:00000040:20.0:1550079902.175373:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.175374:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc40ad7e540 with handle 0x6bcd99f6a79d231b from hash
00010000:00000040:20.0:1550079902.175375:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22297
00010000:00000040:20.0:1550079902.175376:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22298
00010000:00010000:20.0:1550079902.175378:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc40ad7e540/0x6bcd99f6a79d231b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22298 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b747be expref: 22298 pid: 21853 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.175381:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22297
00010000:00000040:20.0:1550079902.175382:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22296
00010000:00000040:20.0:1550079902.175382:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22296
00000020:00000040:20.0:1550079902.175383:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22297
00000001:00000040:20.0:1550079902.175384:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 146
00010000:00000040:5.0:1550079902.175755:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265440
00000004:00000040:5.0:1550079902.175756:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.175756:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265441
00010000:00010000:5.0:1550079902.175758:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca3c4025e80/0x6bcd99f6a7c7870c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265441 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff02960d expref: 265449 pid: 21343 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.175761:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265440
00000020:00000040:5.0:1550079902.175763:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3c4025e80 with handle 0x6bcd99f6a7c7870c from hash
00010000:00000040:5.0:1550079902.175764:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265439
00010000:00000040:5.0:1550079902.175765:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265440
00010000:00010000:5.0:1550079902.175766:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3c4025e80/0x6bcd99f6a7c7870c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265440 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff02960d expref: 265449 pid: 21343 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.175769:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265439
00010000:00000040:5.0:1550079902.175770:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265438
00010000:00000040:5.0:1550079902.175770:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265446
00000020:00000040:5.0:1550079902.175771:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265448
00000001:00000040:5.0:1550079902.175772:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 187
00010000:00000040:20.0:1550079902.176349:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22297
00000004:00000040:20.0:1550079902.176350:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.176351:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc405235100 with handle 0x6bcd99f6a7606582 from hash
00010000:00000040:20.0:1550079902.176352:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22296
00010000:00000040:20.0:1550079902.176353:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22297
00010000:00010000:20.0:1550079902.176355:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc405235100/0x6bcd99f6a7606582 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22297 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b047be expref: 22297 pid: 21803 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.176358:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22296
00010000:00000040:20.0:1550079902.176358:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22295
00010000:00000040:20.0:1550079902.176359:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22295
00000020:00000040:20.0:1550079902.176360:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22296
00000001:00000040:20.0:1550079902.176361:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 147
00010000:00000040:5.0:1550079902.176528:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265439
00000004:00000040:5.0:1550079902.176529:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.176530:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265440
00010000:00010000:5.0:1550079902.176532:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3df3557c0/0x6bcd99f6a793ab7e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265440 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefb960d expref: 265448 pid: 21884 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.176535:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265439
00000020:00000040:5.0:1550079902.176536:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3df3557c0 with handle 0x6bcd99f6a793ab7e from hash
00010000:00000040:5.0:1550079902.176537:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265438
00010000:00000040:5.0:1550079902.176538:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265439
00010000:00010000:5.0:1550079902.176540:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3df3557c0/0x6bcd99f6a793ab7e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265439 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefb960d expref: 265448 pid: 21884 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.176543:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265438
00010000:00000040:5.0:1550079902.176543:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265437
00010000:00000040:5.0:1550079902.176544:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265445
00000020:00000040:5.0:1550079902.176545:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265447
00000001:00000040:5.0:1550079902.176546:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 188
00010000:00000040:5.0:1550079902.177303:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265438
00000004:00000040:5.0:1550079902.177303:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.177304:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265439
00010000:00010000:5.0:1550079902.177305:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb449ec1200/0x6bcd99f6a77065c4 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265439 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef4960d expref: 265447 pid: 20774 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.177309:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265438
00000020:00000040:5.0:1550079902.177310:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb449ec1200 with handle 0x6bcd99f6a77065c4 from hash
00010000:00000040:5.0:1550079902.177311:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265437
00010000:00000040:5.0:1550079902.177312:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265438
00010000:00010000:5.0:1550079902.177313:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb449ec1200/0x6bcd99f6a77065c4 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265438 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef4960d expref: 265447 pid: 20774 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.177316:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265437
00010000:00000040:5.0:1550079902.177317:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265436
00010000:00000040:5.0:1550079902.177317:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265444
00000020:00000040:5.0:1550079902.177318:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265446
00000001:00000040:5.0:1550079902.177319:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 189
00010000:00000040:20.0:1550079902.177326:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22296
00000004:00000040:20.0:1550079902.177327:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.177329:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca351496c00 with handle 0x6bcd99f6a73a2864 from hash
00010000:00000040:20.0:1550079902.177330:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22295
00010000:00000040:20.0:1550079902.177332:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22296
00010000:00010000:20.0:1550079902.177333:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca351496c00/0x6bcd99f6a73a2864 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22296 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a947be expref: 22296 pid: 21318 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.177337:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22295
00010000:00000040:20.0:1550079902.177337:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22294
00010000:00000040:20.0:1550079902.177338:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22294
00000020:00000040:20.0:1550079902.177339:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22295
00000001:00000040:20.0:1550079902.177340:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 148
00010000:00000040:5.0:1550079902.178071:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265437
00000004:00000040:5.0:1550079902.178071:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.178072:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265438
00010000:00010000:5.0:1550079902.178074:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e29cba80/0x6bcd99f6a748f643 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265438 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feed960d expref: 265446 pid: 21271 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.178078:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265437
00000020:00000040:5.0:1550079902.178080:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e29cba80 with handle 0x6bcd99f6a748f643 from hash
00010000:00000040:5.0:1550079902.178081:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265436
00010000:00000040:5.0:1550079902.178081:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265437
00010000:00010000:5.0:1550079902.178083:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e29cba80/0x6bcd99f6a748f643 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265437 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feed960d expref: 265446 pid: 21271 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.178086:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265436
00010000:00000040:5.0:1550079902.178086:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265435
00010000:00000040:5.0:1550079902.178087:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265443
00000020:00000040:5.0:1550079902.178088:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265445
00000001:00000040:5.0:1550079902.178089:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 190
00010000:00000040:20.0:1550079902.178304:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22295
00000004:00000040:20.0:1550079902.178305:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.178306:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3b6281680 with handle 0x6bcd99f6a706ee07 from hash
00010000:00000040:20.0:1550079902.178308:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22294
00010000:00000040:20.0:1550079902.178308:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22295
00010000:00010000:20.0:1550079902.178310:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3b6281680/0x6bcd99f6a706ee07 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22295 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a247be expref: 22295 pid: 21339 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.178313:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22294
00010000:00000040:20.0:1550079902.178314:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22293
00010000:00000040:20.0:1550079902.178314:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22293
00000020:00000040:20.0:1550079902.178315:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22294
00000001:00000040:20.0:1550079902.178316:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 149
00010000:00000040:5.0:1550079902.178841:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265436
00000004:00000040:5.0:1550079902.178842:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.178842:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265437
00010000:00010000:5.0:1550079902.178844:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb410f433c0/0x6bcd99f6a720042c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265437 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee6960d expref: 265445 pid: 21884 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.178847:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265436
00000020:00000040:5.0:1550079902.178849:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb410f433c0 with handle 0x6bcd99f6a720042c from hash
00010000:00000040:5.0:1550079902.178850:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265435
00010000:00000040:5.0:1550079902.178851:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265436
00010000:00010000:5.0:1550079902.178852:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb410f433c0/0x6bcd99f6a720042c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265436 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee6960d expref: 265445 pid: 21884 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.178855:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265435
00010000:00000040:5.0:1550079902.178856:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265434
00010000:00000040:5.0:1550079902.178856:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265442
00000020:00000040:5.0:1550079902.178858:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265444
00000001:00000040:5.0:1550079902.178859:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 191
00010000:00000040:20.0:1550079902.179282:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22294
00000004:00000040:20.0:1550079902.179282:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.179284:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d4df07980 with handle 0x6bcd99f6a9870e92 from hash
00010000:00000040:20.0:1550079902.179285:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22293
00010000:00000040:20.0:1550079902.179286:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22294
00010000:00010000:20.0:1550079902.179288:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d4df07980/0x6bcd99f6a9870e92 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22294 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ed4fbe expref: 22294 pid: 21343 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.179294:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22293
00010000:00000040:20.0:1550079902.179295:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22292
00010000:00000040:20.0:1550079902.179296:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22292
00000020:00000040:20.0:1550079902.179297:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22293
00000001:00000040:20.0:1550079902.179298:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 150
00010000:00000040:5.0:1550079902.179615:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265435
00000004:00000040:5.0:1550079902.179616:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.179617:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265436
00010000:00010000:5.0:1550079902.179619:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb42248ca40/0x6bcd99f6a6fdd0fa lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265436 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedf960d expref: 265444 pid: 21448 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.179622:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265435
00000020:00000040:5.0:1550079902.179624:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb42248ca40 with handle 0x6bcd99f6a6fdd0fa from hash
00010000:00000040:5.0:1550079902.179625:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265434
00010000:00000040:5.0:1550079902.179626:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265435
00010000:00010000:5.0:1550079902.179627:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb42248ca40/0x6bcd99f6a6fdd0fa lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265435 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedf960d expref: 265444 pid: 21448 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.179630:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265434
00010000:00000040:5.0:1550079902.179631:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265433
00010000:00000040:5.0:1550079902.179632:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265441
00000020:00000040:5.0:1550079902.179633:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265443
00000001:00000040:5.0:1550079902.179634:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 192
00010000:00000040:20.0:1550079902.180263:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22293
00000004:00000040:20.0:1550079902.180264:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.180265:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3b16257c0 with handle 0x6bcd99f6a9440eb6 from hash
00010000:00000040:20.0:1550079902.180266:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22292
00010000:00000040:20.0:1550079902.180267:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22293
00010000:00010000:20.0:1550079902.180269:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3b16257c0/0x6bcd99f6a9440eb6 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22293 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e64fbe expref: 22293 pid: 21728 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.180272:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22292
00010000:00000040:20.0:1550079902.180272:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22291
00010000:00000040:20.0:1550079902.180273:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22291
00000020:00000040:20.0:1550079902.180274:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22292
00000001:00000040:20.0:1550079902.180275:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 151
00010000:00000040:5.0:1550079902.180390:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265434
00000004:00000040:5.0:1550079902.180391:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.180392:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265435
00010000:00010000:5.0:1550079902.180393:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e33e586c0/0x6bcd99f6a6d4485c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265435 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed8960d expref: 265443 pid: 21773 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.180397:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265434
00000020:00000040:5.0:1550079902.180398:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e33e586c0 with handle 0x6bcd99f6a6d4485c from hash
00010000:00000040:5.0:1550079902.180399:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265433
00010000:00000040:5.0:1550079902.180400:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265434
00010000:00010000:5.0:1550079902.180402:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e33e586c0/0x6bcd99f6a6d4485c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265434 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed8960d expref: 265443 pid: 21773 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.180405:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265433
00010000:00000040:5.0:1550079902.180406:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265432
00010000:00000040:5.0:1550079902.180406:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265440
00000020:00000040:5.0:1550079902.180407:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265442
00000001:00000040:5.0:1550079902.180408:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 193
00010000:00000040:5.0:1550079902.181164:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265433
00000004:00000040:5.0:1550079902.181165:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.181166:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265434
00010000:00010000:5.0:1550079902.181167:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fd38ad00/0x6bcd99f6a6b2f88e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265434 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed1960d expref: 265442 pid: 21800 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.181170:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265433
00000020:00000040:5.0:1550079902.181171:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3fd38ad00 with handle 0x6bcd99f6a6b2f88e from hash
00010000:00000040:5.0:1550079902.181172:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265432
00010000:00000040:5.0:1550079902.181173:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265433
00010000:00010000:5.0:1550079902.181174:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3fd38ad00/0x6bcd99f6a6b2f88e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265433 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed1960d expref: 265442 pid: 21800 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.181177:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265432
00010000:00000040:5.0:1550079902.181178:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265431
00010000:00000040:5.0:1550079902.181178:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265439
00000020:00000040:5.0:1550079902.181179:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265441
00000001:00000040:5.0:1550079902.181180:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 194
00010000:00000040:20.0:1550079902.181239:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22292
00000004:00000040:20.0:1550079902.181240:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.181242:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4632fc140 with handle 0x6bcd99f6a905aa61 from hash
00010000:00000040:20.0:1550079902.181243:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22291
00010000:00000040:20.0:1550079902.181244:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22292
00010000:00010000:20.0:1550079902.181246:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4632fc140/0x6bcd99f6a905aa61 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22292 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52df4fbe expref: 22292 pid: 21820 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.181249:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22291
00010000:00000040:20.0:1550079902.181250:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22290
00010000:00000040:20.0:1550079902.181251:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22290
00000020:00000040:20.0:1550079902.181252:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22291
00000001:00000040:20.0:1550079902.181253:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 152
00010000:00000040:5.0:1550079902.181932:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265432
00000004:00000040:5.0:1550079902.181932:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.181933:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265433
00010000:00010000:5.0:1550079902.181935:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3dc894c80/0x6bcd99f6a677bc65 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265433 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feca960d expref: 265441 pid: 21849 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.181939:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265432
00000020:00000040:5.0:1550079902.181941:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3dc894c80 with handle 0x6bcd99f6a677bc65 from hash
00010000:00000040:5.0:1550079902.181942:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265431
00010000:00000040:5.0:1550079902.181942:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265432
00010000:00010000:5.0:1550079902.181944:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3dc894c80/0x6bcd99f6a677bc65 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265432 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feca960d expref: 265441 pid: 21849 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.181947:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265431
00010000:00000040:5.0:1550079902.181947:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265430
00010000:00000040:5.0:1550079902.181948:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265438
00000020:00000040:5.0:1550079902.181949:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265440
00000001:00000040:5.0:1550079902.181950:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 195
00010000:00000040:20.0:1550079902.182216:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22291
00000004:00000040:20.0:1550079902.182217:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.182218:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f4f944800 with handle 0x6bcd99f6a8c22df8 from hash
00010000:00000040:20.0:1550079902.182219:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22290
00010000:00000040:20.0:1550079902.182220:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22291
00010000:00010000:20.0:1550079902.182222:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f4f944800/0x6bcd99f6a8c22df8 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22291 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d84fbe expref: 22291 pid: 21811 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.182225:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22290
00010000:00000040:20.0:1550079902.182225:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22289
00010000:00000040:20.0:1550079902.182226:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22289
00000020:00000040:20.0:1550079902.182227:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22290
00000001:00000040:20.0:1550079902.182228:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 153
00010000:00000040:5.0:1550079902.182702:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265431
00000004:00000040:5.0:1550079902.182703:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.182704:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265432
00010000:00010000:5.0:1550079902.182706:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3db183cc0/0x6bcd99f6a88a86cf lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265432 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff389e0d expref: 265440 pid: 21324 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.182709:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265431
00000020:00000040:5.0:1550079902.182710:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3db183cc0 with handle 0x6bcd99f6a88a86cf from hash
00010000:00000040:5.0:1550079902.182711:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265430
00010000:00000040:5.0:1550079902.182712:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265431
00010000:00010000:5.0:1550079902.182713:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3db183cc0/0x6bcd99f6a88a86cf lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265431 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff389e0d expref: 265440 pid: 21324 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.182716:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265430
00010000:00000040:5.0:1550079902.182717:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265429
00010000:00000040:5.0:1550079902.182718:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265437
00000020:00000040:5.0:1550079902.182719:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265439
00000001:00000040:5.0:1550079902.182720:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 196
00010000:00000040:20.0:1550079902.183193:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22290
00000004:00000040:20.0:1550079902.183194:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.183195:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb470f50b40 with handle 0x6bcd99f6a888f5fa from hash
00010000:00000040:20.0:1550079902.183197:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22289
00010000:00000040:20.0:1550079902.183197:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22290
00010000:00010000:20.0:1550079902.183199:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb470f50b40/0x6bcd99f6a888f5fa lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22290 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d14fbe expref: 22290 pid: 21836 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.183202:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22289
00010000:00000040:20.0:1550079902.183203:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22288
00010000:00000040:20.0:1550079902.183204:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22288
00000020:00000040:20.0:1550079902.183205:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22289
00000001:00000040:20.0:1550079902.183206:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 154
00010000:00000040:5.0:1550079902.183476:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265430
00000004:00000040:5.0:1550079902.183477:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.183478:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265431
00010000:00010000:5.0:1550079902.183479:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb472d5d100/0x6bcd99f6a86ea990 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265431 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff319e0d expref: 265439 pid: 20820 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.183483:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265430
00000020:00000040:5.0:1550079902.183484:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb472d5d100 with handle 0x6bcd99f6a86ea990 from hash
00010000:00000040:5.0:1550079902.183485:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265429
00010000:00000040:5.0:1550079902.183486:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265430
00010000:00010000:5.0:1550079902.183487:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb472d5d100/0x6bcd99f6a86ea990 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265430 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff319e0d expref: 265439 pid: 20820 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.183490:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265429
00010000:00000040:5.0:1550079902.183491:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265428
00010000:00000040:5.0:1550079902.183492:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265436
00000020:00000040:5.0:1550079902.183492:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265438
00000001:00000040:5.0:1550079902.183493:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 197
00010000:00000040:20.0:1550079902.184170:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22289
00000004:00000040:20.0:1550079902.184171:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.184173:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46ac4ee40 with handle 0x6bcd99f6a83c22e0 from hash
00010000:00000040:20.0:1550079902.184174:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22288
00010000:00000040:20.0:1550079902.184175:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22289
00010000:00010000:20.0:1550079902.184177:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46ac4ee40/0x6bcd99f6a83c22e0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22289 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ca4fbe expref: 22289 pid: 21866 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.184180:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22288
00010000:00000040:20.0:1550079902.184180:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22287
00010000:00000040:20.0:1550079902.184181:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22287
00000020:00000040:20.0:1550079902.184182:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22288
00000001:00000040:20.0:1550079902.184183:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 155
00010000:00000040:5.0:1550079902.184249:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265429
00000004:00000040:5.0:1550079902.184250:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.184251:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265430
00010000:00010000:5.0:1550079902.184253:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46f3a1680/0x6bcd99f6a85844dd lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265430 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2a9e0d expref: 265438 pid: 20644 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.184256:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265429
00000020:00000040:5.0:1550079902.184257:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46f3a1680 with handle 0x6bcd99f6a85844dd from hash
00010000:00000040:5.0:1550079902.184258:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265428
00010000:00000040:5.0:1550079902.184259:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265429
00010000:00010000:5.0:1550079902.184261:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46f3a1680/0x6bcd99f6a85844dd lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265429 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2a9e0d expref: 265438 pid: 20644 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.184264:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265428
00010000:00000040:5.0:1550079902.184265:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265427
00010000:00000040:5.0:1550079902.184266:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265435
00000020:00000040:5.0:1550079902.184266:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265437
00000001:00000040:5.0:1550079902.184267:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 198
00010000:00000040:5.0:1550079902.185024:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265428
00000004:00000040:5.0:1550079902.185025:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.185026:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265429
00010000:00010000:5.0:1550079902.185027:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd45b61b840/0x6bcd99f6a842209d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265429 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff239e0d expref: 265437 pid: 21820 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.185030:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265428
00000020:00000040:5.0:1550079902.185032:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45b61b840 with handle 0x6bcd99f6a842209d from hash
00010000:00000040:5.0:1550079902.185033:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265427
00010000:00000040:5.0:1550079902.185033:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265428
00010000:00010000:5.0:1550079902.185034:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45b61b840/0x6bcd99f6a842209d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265428 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff239e0d expref: 265437 pid: 21820 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.185038:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265427
00010000:00000040:5.0:1550079902.185038:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265426
00010000:00000040:5.0:1550079902.185039:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265434
00000020:00000040:5.0:1550079902.185039:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265436
00000001:00000040:5.0:1550079902.185040:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 199
00010000:00000040:20.0:1550079902.185146:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22288
00000004:00000040:20.0:1550079902.185147:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.185148:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd446a4c140 with handle 0x6bcd99f6a80df171 from hash
00010000:00000040:20.0:1550079902.185150:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22287
00010000:00000040:20.0:1550079902.185150:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22288
00010000:00010000:20.0:1550079902.185152:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd446a4c140/0x6bcd99f6a80df171 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22288 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c34fbe expref: 22288 pid: 21799 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.185155:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22287
00010000:00000040:20.0:1550079902.185156:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22286
00010000:00000040:20.0:1550079902.185157:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22286
00000020:00000040:20.0:1550079902.185157:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22287
00000001:00000040:20.0:1550079902.185159:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 156
00010000:00000040:5.0:1550079902.185788:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265427
00000004:00000040:5.0:1550079902.185789:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.185790:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265428
00010000:00010000:5.0:1550079902.185791:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc43b646780/0x6bcd99f6a82f46e1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265428 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1c9e0d expref: 265436 pid: 21271 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.185795:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265427
00000020:00000040:5.0:1550079902.185797:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc43b646780 with handle 0x6bcd99f6a82f46e1 from hash
00010000:00000040:5.0:1550079902.185798:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265426
00010000:00000040:5.0:1550079902.185798:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265427
00010000:00010000:5.0:1550079902.185800:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc43b646780/0x6bcd99f6a82f46e1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265427 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1c9e0d expref: 265436 pid: 21271 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.185803:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265426
00010000:00000040:5.0:1550079902.185803:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265425
00010000:00000040:5.0:1550079902.185804:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265433
00000020:00000040:5.0:1550079902.185805:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265435
00000001:00000040:5.0:1550079902.185806:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 200
00010000:00000040:20.0:1550079902.186124:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22287
00000004:00000040:20.0:1550079902.186124:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.186126:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc46ad0c140 with handle 0x6bcd99f6a7ba2581 from hash
00010000:00000040:20.0:1550079902.186127:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22286
00010000:00000040:20.0:1550079902.186128:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22287
00010000:00010000:20.0:1550079902.186130:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc46ad0c140/0x6bcd99f6a7ba2581 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22287 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bc4fbe expref: 22287 pid: 20581 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.186133:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22286
00010000:00000040:20.0:1550079902.186134:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22285
00010000:00000040:20.0:1550079902.186135:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22285
00000020:00000040:20.0:1550079902.186135:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22286
00000001:00000040:20.0:1550079902.186136:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 157
00010000:00000040:5.0:1550079902.186563:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265426
00000004:00000040:5.0:1550079902.186564:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.186565:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265427
00010000:00010000:5.0:1550079902.186566:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e7401f80/0x6bcd99f6a81d9873 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265427 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff159e0d expref: 265435 pid: 21736 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.186570:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265426
00000020:00000040:5.0:1550079902.186571:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3e7401f80 with handle 0x6bcd99f6a81d9873 from hash
00010000:00000040:5.0:1550079902.186572:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265425
00010000:00000040:5.0:1550079902.186573:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265426
00010000:00010000:5.0:1550079902.186574:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e7401f80/0x6bcd99f6a81d9873 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265426 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff159e0d expref: 265435 pid: 21736 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.186577:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265425
00010000:00000040:5.0:1550079902.186578:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265424
00010000:00000040:5.0:1550079902.186579:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265432
00000020:00000040:5.0:1550079902.186580:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265434
00000001:00000040:5.0:1550079902.186581:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 201
00010000:00000040:20.0:1550079902.187101:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22286
00000004:00000040:20.0:1550079902.187102:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.187104:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4a6254140 with handle 0x6bcd99f6a78aa44a from hash
00010000:00000040:20.0:1550079902.187105:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22285
00010000:00000040:20.0:1550079902.187106:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22286
00010000:00010000:20.0:1550079902.187108:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a6254140/0x6bcd99f6a78aa44a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22286 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b54fbe expref: 22286 pid: 21794 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.187111:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22285
00010000:00000040:20.0:1550079902.187111:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22284
00010000:00000040:20.0:1550079902.187112:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22284
00000020:00000040:20.0:1550079902.187113:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22285
00000001:00000040:20.0:1550079902.187114:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 158
00010000:00000040:5.0:1550079902.187337:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265425
00000004:00000040:5.0:1550079902.187338:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.187339:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265426
00010000:00010000:5.0:1550079902.187340:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd3da690240/0x6bcd99f6a8088c4f lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265426 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0e9e0d expref: 265434 pid: 21736 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.187343:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265425
00000020:00000040:5.0:1550079902.187345:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3da690240 with handle 0x6bcd99f6a8088c4f from hash
00010000:00000040:5.0:1550079902.187346:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265424
00010000:00000040:5.0:1550079902.187347:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265425
00010000:00010000:5.0:1550079902.187348:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3da690240/0x6bcd99f6a8088c4f lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265425 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0e9e0d expref: 265434 pid: 21736 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.187351:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265424
00010000:00000040:5.0:1550079902.187352:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265423
00010000:00000040:5.0:1550079902.187353:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265431
00000020:00000040:5.0:1550079902.187353:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265433
00000001:00000040:5.0:1550079902.187354:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 202
00010000:00000040:20.0:1550079902.188079:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22285
00000004:00000040:20.0:1550079902.188080:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.188081:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca44f718d80 with handle 0x6bcd99f6a75721cb from hash
00010000:00000040:20.0:1550079902.188082:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22284
00010000:00000040:20.0:1550079902.188083:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22285
00010000:00010000:20.0:1550079902.188085:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca44f718d80/0x6bcd99f6a75721cb lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22285 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ae4fbe expref: 22285 pid: 21833 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.188088:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22284
00010000:00000040:20.0:1550079902.188089:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22283
00010000:00000040:20.0:1550079902.188090:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22283
00000020:00000040:20.0:1550079902.188090:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22284
00000001:00000040:20.0:1550079902.188092:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 159
00010000:00000040:5.0:1550079902.188111:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265424
00000004:00000040:5.0:1550079902.188112:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.188113:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265425
00010000:00010000:5.0:1550079902.188114:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9db8aba400/0x6bcd99f6a7e9e396 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265425 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff079e0d expref: 265433 pid: 21793 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.188118:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265424
00000020:00000040:5.0:1550079902.188119:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9db8aba400 with handle 0x6bcd99f6a7e9e396 from hash
00010000:00000040:5.0:1550079902.188120:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265423
00010000:00000040:5.0:1550079902.188121:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265424
00010000:00010000:5.0:1550079902.188123:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9db8aba400/0x6bcd99f6a7e9e396 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265424 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff079e0d expref: 265433 pid: 21793 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.188126:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265423
00010000:00000040:5.0:1550079902.188127:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265422
00010000:00000040:5.0:1550079902.188128:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265430
00000020:00000040:5.0:1550079902.188128:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265432
00000001:00000040:5.0:1550079902.188130:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 203
00010000:00000040:5.0:1550079902.188886:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265423
00000004:00000040:5.0:1550079902.188886:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.188887:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265424
00010000:00010000:5.0:1550079902.188888:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd48eecd100/0x6bcd99f6a7b9b50a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265424 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff009e0d expref: 265432 pid: 20793 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.188892:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265423
00000020:00000040:5.0:1550079902.188893:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48eecd100 with handle 0x6bcd99f6a7b9b50a from hash
00010000:00000040:5.0:1550079902.188894:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265422
00010000:00000040:5.0:1550079902.188895:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265423
00010000:00010000:5.0:1550079902.188896:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48eecd100/0x6bcd99f6a7b9b50a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265423 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff009e0d expref: 265432 pid: 20793 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.188899:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265422
00010000:00000040:5.0:1550079902.188900:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265421
00010000:00000040:5.0:1550079902.188900:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265429
00000020:00000040:5.0:1550079902.188901:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265431
00000001:00000040:5.0:1550079902.188902:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 204
00010000:00000040:20.0:1550079902.189056:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22284
00000004:00000040:20.0:1550079902.189057:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.189058:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd493298d80 with handle 0x6bcd99f6a72952e1 from hash
00010000:00000040:20.0:1550079902.189059:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22283
00010000:00000040:20.0:1550079902.189060:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22284
00010000:00010000:20.0:1550079902.189062:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd493298d80/0x6bcd99f6a72952e1 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22284 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a74fbe expref: 22284 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.189065:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22283
00010000:00000040:20.0:1550079902.189065:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22282
00010000:00000040:20.0:1550079902.189066:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22282
00000020:00000040:20.0:1550079902.189067:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22283
00000001:00000040:20.0:1550079902.189068:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 160
00010000:00000040:5.0:1550079902.189649:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265422
00000004:00000040:5.0:1550079902.189650:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.189651:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265423
00010000:00010000:5.0:1550079902.189652:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd45ac8ba80/0x6bcd99f6a78c0840 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265423 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef99e0d expref: 265431 pid: 21794 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.189657:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265422
00000020:00000040:5.0:1550079902.189658:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45ac8ba80 with handle 0x6bcd99f6a78c0840 from hash
00010000:00000040:5.0:1550079902.189659:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265421
00010000:00000040:5.0:1550079902.189660:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265422
00010000:00010000:5.0:1550079902.189661:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45ac8ba80/0x6bcd99f6a78c0840 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265422 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef99e0d expref: 265431 pid: 21794 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.189664:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265421
00010000:00000040:5.0:1550079902.189665:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265420
00010000:00000040:5.0:1550079902.189666:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265428
00000020:00000040:5.0:1550079902.189666:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265430
00000001:00000040:5.0:1550079902.189667:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 205
00010000:00000040:20.0:1550079902.190032:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22283
00000004:00000040:20.0:1550079902.190033:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.190034:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d9691e780 with handle 0x6bcd99f6a6fea3be from hash
00010000:00000040:20.0:1550079902.190036:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22282
00010000:00000040:20.0:1550079902.190037:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22283
00010000:00010000:20.0:1550079902.190038:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d9691e780/0x6bcd99f6a6fea3be lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22283 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a04fbe expref: 22283 pid: 21811 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.190041:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22282
00010000:00000040:20.0:1550079902.190042:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22281
00010000:00000040:20.0:1550079902.190043:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22281
00000020:00000040:20.0:1550079902.190043:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22282
00000001:00000040:20.0:1550079902.190045:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 161
00010000:00000040:5.0:1550079902.190423:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265421
00000004:00000040:5.0:1550079902.190424:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.190425:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265422
00010000:00010000:5.0:1550079902.190426:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c860fbc0/0x6bcd99f6a76035e0 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265422 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef29e0d expref: 265430 pid: 20808 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.190430:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265421
00000020:00000040:5.0:1550079902.190431:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3c860fbc0 with handle 0x6bcd99f6a76035e0 from hash
00010000:00000040:5.0:1550079902.190432:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265420
00010000:00000040:5.0:1550079902.190433:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265421
00010000:00010000:5.0:1550079902.190434:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c860fbc0/0x6bcd99f6a76035e0 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265421 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef29e0d expref: 265430 pid: 20808 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.190437:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265420
00010000:00000040:5.0:1550079902.190438:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265419
00010000:00000040:5.0:1550079902.190439:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265427
00000020:00000040:5.0:1550079902.190440:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265429
00000001:00000040:5.0:1550079902.190441:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 206
00010000:00000040:20.0:1550079902.191010:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22282
00000004:00000040:20.0:1550079902.191011:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.191012:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4618c3cc0 with handle 0x6bcd99f6a97db69f from hash
00010000:00000040:20.0:1550079902.191013:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22281
00010000:00000040:20.0:1550079902.191014:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22282
00010000:00010000:20.0:1550079902.191016:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4618c3cc0/0x6bcd99f6a97db69f lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22282 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52eb57be expref: 22282 pid: 21466 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.191019:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22281
00010000:00000040:20.0:1550079902.191019:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22280
00010000:00000040:20.0:1550079902.191020:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22280
00000020:00000040:20.0:1550079902.191021:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22281
00000001:00000040:20.0:1550079902.191022:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 162
00010000:00000040:5.0:1550079902.191197:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265420
00000004:00000040:5.0:1550079902.191198:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.191198:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265421
00010000:00010000:5.0:1550079902.191200:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e658660c0/0x6bcd99f6a7428943 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265421 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feeb9e0d expref: 265429 pid: 20616 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.191203:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265420
00000020:00000040:5.0:1550079902.191205:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e658660c0 with handle 0x6bcd99f6a7428943 from hash
00010000:00000040:5.0:1550079902.191206:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265419
00010000:00000040:5.0:1550079902.191207:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265420
00010000:00010000:5.0:1550079902.191208:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e658660c0/0x6bcd99f6a7428943 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265420 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feeb9e0d expref: 265429 pid: 20616 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.191211:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265419
00010000:00000040:5.0:1550079902.191212:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265418
00010000:00000040:5.0:1550079902.191213:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265426
00000020:00000040:5.0:1550079902.191213:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265428
00000001:00000040:5.0:1550079902.191215:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 207
00000100:00000040:0.0F:1550079902.191369:0:20239:0:(events.c:348:request_in_callback()) incoming req@ffff9ca40e074b00 x1624711767245056 msgsize 224
00000020:00000040:36.0:1550079902.191380:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa140f9
00000100:00000040:41.0:1550079902.191381:0:20240:0:(events.c:348:request_in_callback()) incoming req@ffff9cd4a69b6c50 x1624711767245040 msgsize 224
00000100:00000040:41.0:1550079902.191382:0:20240:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:36.0:1550079902.191383:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482d81c00 : new refcount 6
00000100:00000040:36.0:1550079902.191387:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +21s
00000020:00000040:11.0:1550079902.191390:0:38445:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f60a253a2d
00000100:00000040:36.0:1550079902.191392:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482d81c00 : new rpc_count 1
00000020:00000040:11.0:1550079902.191392:0:38445:0:(genops.c:1008:class_export_get()) GETting export ffff9c94fbc57400 : new refcount 17
00000100:00000040:36.0:1550079902.191394:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca40e074b00 x1624711767245056/t0(0) o400->7ecda3d5-6e86-7907-ec95-3ef4a7a0262e@10.8.6.8@o2ib6:753/0 lens 224/0 e 0 to 0 dl 1550079928 ref 1 fl New:H/0/ffffffff rc 0/-1
00000100:00000040:11.0:1550079902.191395:0:38445:0:(service.c:1210:ptlrpc_at_set_timer()) armed mgs at +38s
00000100:00000040:11.0:1550079902.191398:0:38445:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9c94fbc57400 : new rpc_count 1
00000100:00000040:11.0:1550079902.191400:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cd4a69b6c50 x1624711767245040/t0(0) o400->c6dc8656-5930-6625-0294-d01f1f50ce5b@10.8.6.8@o2ib6:15/0 lens 224/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00000040:36.0:1550079902.191402:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 0, transno 0, xid 1624711767245056
00000100:00000040:36.0:1550079902.191404:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cc4857976c0 refcount 6 to 10.8.6.8@o2ib6
00010000:00000040:11.0:1550079902.191406:0:38445:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 0, transno 0, xid 1624711767245040
00000100:00000040:36.0:1550079902.191407:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.6.8@o2ib6
00000100:00000040:11.0:1550079902.191408:0:38445:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cc4857976c0 refcount 7 to 10.8.6.8@o2ib6
00000100:00000040:11.0:1550079902.191410:0:38445:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.6.8@o2ib6
00000100:00000040:36.0:1550079902.191421:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cc4857976c0 refcount 6 to 10.8.6.8@o2ib6
00000100:00000040:36.0:1550079902.191422:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca40e074b00 x1624711767245056/t0(0) o400->7ecda3d5-6e86-7907-ec95-3ef4a7a0262e@10.8.6.8@o2ib6:753/0 lens 224/192 e 0 to 0 dl 1550079928 ref 1 fl Interpret:H/0/0 rc 0/0
00000100:00000040:11.0:1550079902.191423:0:38445:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cc4857976c0 refcount 5 to 10.8.6.8@o2ib6
00000100:00000040:11.0:1550079902.191425:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cd4a69b6c50 x1624711767245040/t0(0) o400->c6dc8656-5930-6625-0294-d01f1f50ce5b@10.8.6.8@o2ib6:15/0 lens 224/192 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.191427:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482d81c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.191430:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482d81c00 : new refcount 5
00000100:00000040:11.0:1550079902.191430:0:38445:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c94fbc57400 : new rpc_count 0
00000020:00000040:11.0:1550079902.191432:0:38445:0:(genops.c:1018:class_export_put()) PUTting export ffff9c94fbc57400 : new refcount 16
00010000:00000040:5.0:1550079902.191971:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265419
00000004:00000040:5.0:1550079902.191971:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.191972:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265420
00010000:00010000:5.0:1550079902.191974:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3b922cc80/0x6bcd99f6a7150f24 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265420 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee49e0d expref: 265428 pid: 21456 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.191977:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265419
00000020:00000040:5.0:1550079902.191978:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3b922cc80 with handle 0x6bcd99f6a7150f24 from hash
00010000:00000040:5.0:1550079902.191979:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265418
00010000:00000040:5.0:1550079902.191980:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265419
00010000:00010000:5.0:1550079902.191982:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3b922cc80/0x6bcd99f6a7150f24 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265419 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee49e0d expref: 265428 pid: 21456 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.191985:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265418
00010000:00000040:5.0:1550079902.191985:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265417
00010000:00000040:5.0:1550079902.191986:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265425
00010000:00000040:20.0:1550079902.191987:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22281
00000020:00000040:5.0:1550079902.191987:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265427
00000004:00000040:20.0:1550079902.191988:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000001:00000040:5.0:1550079902.191988:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 208
00000020:00000040:20.0:1550079902.191989:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd49dc8f2c0 with handle 0x6bcd99f6a92e3523 from hash
00010000:00000040:20.0:1550079902.191991:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22280
00010000:00000040:20.0:1550079902.191992:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22281
00010000:00010000:20.0:1550079902.191993:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd49dc8f2c0/0x6bcd99f6a92e3523 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22281 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e457be expref: 22281 pid: 21799 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.191996:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22280
00010000:00000040:20.0:1550079902.191997:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22279
00010000:00000040:20.0:1550079902.191998:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22279
00000020:00000040:20.0:1550079902.191999:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22280
00000001:00000040:20.0:1550079902.191999:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 163
00010000:00000040:5.0:1550079902.192737:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265418
00000004:00000040:5.0:1550079902.192738:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.192739:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265419
00010000:00010000:5.0:1550079902.192741:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e8986e780/0x6bcd99f6a6f24724 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265419 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedd9e0d expref: 265427 pid: 21329 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.192744:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265418
00000020:00000040:5.0:1550079902.192746:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e8986e780 with handle 0x6bcd99f6a6f24724 from hash
00010000:00000040:5.0:1550079902.192747:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265417
00010000:00000040:5.0:1550079902.192747:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265418
00010000:00010000:5.0:1550079902.192749:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e8986e780/0x6bcd99f6a6f24724 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265418 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedd9e0d expref: 265427 pid: 21329 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.192752:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265417
00010000:00000040:5.0:1550079902.192752:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265416
00010000:00000040:5.0:1550079902.192753:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265424
00000020:00000040:5.0:1550079902.192754:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265426
00000001:00000040:5.0:1550079902.192755:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 209
00010000:00000040:20.0:1550079902.192964:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22280
00000004:00000040:20.0:1550079902.192965:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.192967:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb20975bcc0 with handle 0x6bcd99f6a8fa6733 from hash
00010000:00000040:20.0:1550079902.192968:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22279
00010000:00000040:20.0:1550079902.192969:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22280
00010000:00010000:20.0:1550079902.192971:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb20975bcc0/0x6bcd99f6a8fa6733 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22280 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52dd57be expref: 22280 pid: 21447 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.192974:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22279
00010000:00000040:20.0:1550079902.192975:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22278
00010000:00000040:20.0:1550079902.192975:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22278
00000020:00000040:20.0:1550079902.192976:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22279
00000001:00000040:20.0:1550079902.192977:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 164
00010000:00000040:5.0:1550079902.193510:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265417
00000004:00000040:5.0:1550079902.193511:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.193512:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265418
00010000:00010000:5.0:1550079902.193514:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f2368b40/0x6bcd99f6a6c6a0ca lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265418 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed69e0d expref: 265426 pid: 21450 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.193518:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265417
00000020:00000040:5.0:1550079902.193520:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f2368b40 with handle 0x6bcd99f6a6c6a0ca from hash
00010000:00000040:5.0:1550079902.193521:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265416
00010000:00000040:5.0:1550079902.193522:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265417
00010000:00010000:5.0:1550079902.193523:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f2368b40/0x6bcd99f6a6c6a0ca lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265417 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed69e0d expref: 265426 pid: 21450 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.193526:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265416
00010000:00000040:5.0:1550079902.193527:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265415
00010000:00000040:5.0:1550079902.193528:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265423
00000020:00000040:5.0:1550079902.193529:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265425
00000001:00000040:5.0:1550079902.193530:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 210
00010000:00000040:20.0:1550079902.193943:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22279
00000004:00000040:20.0:1550079902.193943:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.193945:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4f0fb8480 with handle 0x6bcd99f6a8b14527 from hash
00010000:00000040:20.0:1550079902.193946:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22278
00010000:00000040:20.0:1550079902.193947:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22279
00010000:00010000:20.0:1550079902.193949:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4f0fb8480/0x6bcd99f6a8b14527 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22279 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d657be expref: 22279 pid: 20534 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.193952:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22278
00010000:00000040:20.0:1550079902.193953:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22277
00010000:00000040:20.0:1550079902.193953:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22277
00000020:00000040:20.0:1550079902.193954:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22278
00000001:00000040:20.0:1550079902.193955:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 165
00010000:00000040:5.0:1550079902.194285:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265416
00000004:00000040:5.0:1550079902.194286:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.194287:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265417
00010000:00010000:5.0:1550079902.194289:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd49ac90d80/0x6bcd99f6a6a3a14f lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265417 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecf9e0d expref: 265425 pid: 21711 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.194293:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265416
00000020:00000040:5.0:1550079902.194294:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd49ac90d80 with handle 0x6bcd99f6a6a3a14f from hash
00010000:00000040:5.0:1550079902.194295:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265415
00010000:00000040:5.0:1550079902.194296:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265416
00010000:00010000:5.0:1550079902.194297:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd49ac90d80/0x6bcd99f6a6a3a14f lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265416 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecf9e0d expref: 265425 pid: 21711 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.194300:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265415
00010000:00000040:5.0:1550079902.194301:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265414
00010000:00000040:5.0:1550079902.194301:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265422
00000020:00000040:5.0:1550079902.194303:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265424
00000001:00000040:5.0:1550079902.194304:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 211
00010000:00000040:20.0:1550079902.194920:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22278
00000004:00000040:20.0:1550079902.194921:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.194923:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f059b2d00 with handle 0x6bcd99f6a87415a4 from hash
00010000:00000040:20.0:1550079902.194924:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22277
00010000:00000040:20.0:1550079902.194925:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22278
00010000:00010000:20.0:1550079902.194926:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f059b2d00/0x6bcd99f6a87415a4 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22278 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52cf57be expref: 22278 pid: 20612 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.194933:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22277
00010000:00000040:20.0:1550079902.194934:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22276
00010000:00000040:20.0:1550079902.194934:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22276
00000020:00000040:20.0:1550079902.194935:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22277
00000001:00000040:20.0:1550079902.194936:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 166
00010000:00000040:5.0:1550079902.195061:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265415
00000004:00000040:5.0:1550079902.195062:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.195062:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265416
00010000:00010000:5.0:1550079902.195064:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb423b3cc80/0x6bcd99f6a89e2923 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265416 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3da60d expref: 265424 pid: 21884 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.195067:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265415
00000020:00000040:5.0:1550079902.195069:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb423b3cc80 with handle 0x6bcd99f6a89e2923 from hash
00010000:00000040:5.0:1550079902.195070:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265414
00010000:00000040:5.0:1550079902.195071:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265415
00010000:00010000:5.0:1550079902.195072:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb423b3cc80/0x6bcd99f6a89e2923 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265415 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3da60d expref: 265424 pid: 21884 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.195075:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265414
00010000:00000040:5.0:1550079902.195076:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265413
00010000:00000040:5.0:1550079902.195077:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265421
00000020:00000040:5.0:1550079902.195077:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265423
00000001:00000040:5.0:1550079902.195078:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 212
00010000:00000040:5.0:1550079902.195830:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265414
00000004:00000040:5.0:1550079902.195831:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.195832:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265415
00010000:00010000:5.0:1550079902.195833:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb41f6c1b00/0x6bcd99f6a87ffc10 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265415 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff36a60d expref: 265423 pid: 21456 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.195836:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265414
00000020:00000040:5.0:1550079902.195837:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb41f6c1b00 with handle 0x6bcd99f6a87ffc10 from hash
00010000:00000040:5.0:1550079902.195838:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265413
00010000:00000040:5.0:1550079902.195839:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265414
00010000:00010000:5.0:1550079902.195841:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb41f6c1b00/0x6bcd99f6a87ffc10 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265414 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff36a60d expref: 265423 pid: 21456 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.195844:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265413
00010000:00000040:5.0:1550079902.195844:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265412
00010000:00000040:5.0:1550079902.195845:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265420
00000020:00000040:5.0:1550079902.195846:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265422
00000001:00000040:5.0:1550079902.195846:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 213
00010000:00000040:20.0:1550079902.195902:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22277
00000004:00000040:20.0:1550079902.195903:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.195905:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f15dcec0 with handle 0x6bcd99f6a8265777 from hash
00010000:00000040:20.0:1550079902.195907:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22276
00010000:00000040:20.0:1550079902.195907:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22277
00010000:00010000:20.0:1550079902.195909:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f15dcec0/0x6bcd99f6a8265777 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22277 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c857be expref: 22277 pid: 21581 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.195912:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22276
00010000:00000040:20.0:1550079902.195913:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22275
00010000:00000040:20.0:1550079902.195914:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22275
00000020:00000040:20.0:1550079902.195914:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22276
00000001:00000040:20.0:1550079902.195915:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 167
00010000:00000040:5.0:1550079902.196599:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265413
00000004:00000040:5.0:1550079902.196600:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.196601:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265414
00010000:00010000:5.0:1550079902.196603:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a8f86300/0x6bcd99f6a8652f76 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265414 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2fa60d expref: 265422 pid: 21794 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.196606:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265413
00000020:00000040:5.0:1550079902.196607:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4a8f86300 with handle 0x6bcd99f6a8652f76 from hash
00010000:00000040:5.0:1550079902.196608:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265412
00010000:00000040:5.0:1550079902.196609:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265413
00010000:00010000:5.0:1550079902.196610:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a8f86300/0x6bcd99f6a8652f76 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265413 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2fa60d expref: 265422 pid: 21794 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.196613:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265412
00010000:00000040:5.0:1550079902.196614:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265411
00010000:00000040:5.0:1550079902.196615:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265419
00000020:00000040:5.0:1550079902.196616:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265421
00000001:00000040:5.0:1550079902.196617:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 214
00010000:00000040:20.0:1550079902.196880:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22276
00000004:00000040:20.0:1550079902.196881:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.196882:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd471dcdc40 with handle 0x6bcd99f6a7f329c3 from hash
00010000:00000040:20.0:1550079902.196883:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22275
00010000:00000040:20.0:1550079902.196884:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22276
00010000:00010000:20.0:1550079902.196886:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd471dcdc40/0x6bcd99f6a7f329c3 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22276 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c157be expref: 22276 pid: 21448 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.196889:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22275
00010000:00000040:20.0:1550079902.196890:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22274
00010000:00000040:20.0:1550079902.196891:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22274
00000020:00000040:20.0:1550079902.196892:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22275
00000001:00000040:20.0:1550079902.196893:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 168
00010000:00000040:5.0:1550079902.197373:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265412
00000004:00000040:5.0:1550079902.197373:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.197374:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265413
00010000:00010000:5.0:1550079902.197376:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb421044800/0x6bcd99f6a84efe08 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265413 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff28a60d expref: 265421 pid: 20645 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.197380:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265412
00000020:00000040:5.0:1550079902.197381:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb421044800 with handle 0x6bcd99f6a84efe08 from hash
00010000:00000040:5.0:1550079902.197382:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265411
00010000:00000040:5.0:1550079902.197383:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265412
00010000:00010000:5.0:1550079902.197384:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb421044800/0x6bcd99f6a84efe08 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265412 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff28a60d expref: 265421 pid: 20645 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.197387:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265411
00010000:00000040:5.0:1550079902.197388:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265410
00010000:00000040:5.0:1550079902.197389:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265418
00000020:00000040:5.0:1550079902.197390:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265420
00000001:00000040:5.0:1550079902.197391:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 215
00010000:00000040:20.0:1550079902.197854:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22275
00000004:00000040:20.0:1550079902.197855:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.197856:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e7f59680 with handle 0x6bcd99f6a7a9e4a9 from hash
00010000:00000040:20.0:1550079902.197858:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22274
00010000:00000040:20.0:1550079902.197859:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22275
00010000:00010000:20.0:1550079902.197864:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e7f59680/0x6bcd99f6a7a9e4a9 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22275 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ba57be expref: 22275 pid: 21356 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.197867:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22274
00010000:00000040:20.0:1550079902.197868:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22273
00010000:00000040:20.0:1550079902.197869:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22273
00000020:00000040:20.0:1550079902.197869:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22274
00000001:00000040:20.0:1550079902.197870:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 169
00010000:00000040:5.0:1550079902.198148:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265411
00000004:00000040:5.0:1550079902.198149:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.198150:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265412
00010000:00010000:5.0:1550079902.198151:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f4d45e80/0x6bcd99f6a83d3df7 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265412 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff21a60d expref: 265420 pid: 21859 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.198155:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265411
00000020:00000040:5.0:1550079902.198156:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3f4d45e80 with handle 0x6bcd99f6a83d3df7 from hash
00010000:00000040:5.0:1550079902.198157:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265410
00010000:00000040:5.0:1550079902.198158:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265411
00010000:00010000:5.0:1550079902.198160:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3f4d45e80/0x6bcd99f6a83d3df7 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265411 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff21a60d expref: 265420 pid: 21859 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.198163:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265410
00010000:00000040:5.0:1550079902.198163:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265409
00010000:00000040:5.0:1550079902.198164:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265417
00000020:00000040:5.0:1550079902.198165:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265419
00000001:00000040:5.0:1550079902.198166:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 216
00010000:00000040:20.0:1550079902.198831:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22274
00000004:00000040:20.0:1550079902.198832:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.198834:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4acdcf2c0 with handle 0x6bcd99f6a777d2de from hash
00010000:00000040:20.0:1550079902.198835:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22273
00010000:00000040:20.0:1550079902.198836:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22274
00010000:00010000:20.0:1550079902.198838:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4acdcf2c0/0x6bcd99f6a777d2de lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22274 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b357be expref: 22274 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.198841:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22273
00010000:00000040:20.0:1550079902.198842:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22272
00010000:00000040:20.0:1550079902.198842:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22272
00000020:00000040:20.0:1550079902.198843:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22273
00000001:00000040:20.0:1550079902.198844:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 170
00010000:00000040:5.0:1550079902.198924:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265410
00000004:00000040:5.0:1550079902.198925:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.198926:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265411
00010000:00010000:5.0:1550079902.198927:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4888d72c0/0x6bcd99f6a82babe4 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265411 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1aa60d expref: 265419 pid: 21859 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.198931:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265410
00000020:00000040:5.0:1550079902.198932:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4888d72c0 with handle 0x6bcd99f6a82babe4 from hash
00010000:00000040:5.0:1550079902.198933:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265409
00010000:00000040:5.0:1550079902.198934:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265410
00010000:00010000:5.0:1550079902.198935:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4888d72c0/0x6bcd99f6a82babe4 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265410 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1aa60d expref: 265419 pid: 21859 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.198938:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265409
00010000:00000040:5.0:1550079902.198939:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265408
00010000:00000040:5.0:1550079902.198939:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265416
00000020:00000040:5.0:1550079902.198940:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265418
00000001:00000040:5.0:1550079902.198941:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 217
00000100:00000040:32.0:1550079902.199598:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca4431a4800 x1623974274135072 msgsize 304
00000020:00000040:36.0:1550079902.199606:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.199609:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.199611:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.199615:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.199617:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca4431a4800 x1623974274135072/t0(0) o501->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 304/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.199625:0:21809:0:(llog_server.c:83:llog_origin_handle_open()) fir-MDT0000: opening log changelog_catalog
00000040:00000040:36.0:1550079902.199626:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.199652:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.199654:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135072
00000100:00000040:36.0:1550079902.199656:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199658:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199669:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199670:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca4431a4800 x1623974274135072/t0(0) o501->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 304/240 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.199675:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.199677:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00010000:00000040:5.0:1550079902.199693:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265409
00000004:00000040:5.0:1550079902.199694:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.199695:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265410
00010000:00010000:5.0:1550079902.199697:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd459ff9d40/0x6bcd99f6a817cf7c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265410 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff13a60d expref: 265418 pid: 21721 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.199700:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265409
00000020:00000040:5.0:1550079902.199701:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd459ff9d40 with handle 0x6bcd99f6a817cf7c from hash
00010000:00000040:5.0:1550079902.199702:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265408
00010000:00000040:5.0:1550079902.199703:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265409
00010000:00010000:5.0:1550079902.199705:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd459ff9d40/0x6bcd99f6a817cf7c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265409 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff13a60d expref: 265418 pid: 21721 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.199708:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265408
00010000:00000040:5.0:1550079902.199709:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265407
00010000:00000040:5.0:1550079902.199709:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265415
00000020:00000040:5.0:1550079902.199710:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265417
00000001:00000040:5.0:1550079902.199711:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 218
00000100:00000040:0.0:1550079902.199747:0:20239:0:(events.c:348:request_in_callback()) incoming req@ffff9ca40e075100 x1623974274135088 msgsize 272
00000020:00000040:36.0:1550079902.199754:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.199755:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.199757:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.199760:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.199762:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca40e075100 x1623974274135088/t0(0) o503->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.199771:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.199781:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.199782:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135088
00000100:00000040:36.0:1550079902.199784:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199786:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199793:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199795:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca40e075100 x1623974274135088/t0(0) o503->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8384 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.199799:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.199800:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00010000:00000040:20.0:1550079902.199810:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22273
00000004:00000040:20.0:1550079902.199812:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.199813:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca229f018c0 with handle 0x6bcd99f6a7503987 from hash
00010000:00000040:20.0:1550079902.199815:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22272
00010000:00000040:20.0:1550079902.199815:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22273
00010000:00010000:20.0:1550079902.199817:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca229f018c0/0x6bcd99f6a7503987 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22273 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ac57be expref: 22273 pid: 20527 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.199820:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22272
00010000:00000040:20.0:1550079902.199820:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22271
00010000:00000040:20.0:1550079902.199821:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22271
00000020:00000040:20.0:1550079902.199822:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22272
00000001:00000040:20.0:1550079902.199823:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 171
00000100:00000040:0.0:1550079902.199924:0:20239:0:(events.c:348:request_in_callback()) incoming req@ffff9ca40e075400 x1623974274135104 msgsize 272
00000020:00000040:36.0:1550079902.199931:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.199931:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.199934:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.199937:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.199938:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca40e075400 x1623974274135104/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.199946:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.199959:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.199959:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135104
00000100:00000040:36.0:1550079902.199962:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199963:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199970:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.199972:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca40e075400 x1623974274135104/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.199976:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.199977:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:0.0:1550079902.200071:0:20239:0:(events.c:348:request_in_callback()) incoming req@ffff9ca40e075a00 x1623974274135120 msgsize 272
00000020:00000040:36.0:1550079902.200078:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200079:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.200080:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.200083:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200084:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca40e075a00 x1623974274135120/t0(0) o501->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.200090:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200092:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200093:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135120
00000100:00000040:36.0:1550079902.200095:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200096:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200102:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200103:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca40e075a00 x1623974274135120/t0(0) o501->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/240 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200107:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.200109:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.200163:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca4431a1800 x1623974274135136 msgsize 272
00000020:00000040:36.0:1550079902.200170:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200171:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.200172:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.200175:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200176:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca4431a1800 x1623974274135136/t0(0) o503->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.200183:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200192:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200193:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135136
00000100:00000040:36.0:1550079902.200195:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200197:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200203:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200204:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca4431a1800 x1623974274135136/t0(0) o503->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8384 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200208:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.200209:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.200308:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca4431a1200 x1623974274135152 msgsize 272
00000020:00000040:36.0:1550079902.200314:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200315:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.200317:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.200320:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200321:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca4431a1200 x1623974274135152/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.200328:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200351:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200351:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135152
00000100:00000040:36.0:1550079902.200354:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200355:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200362:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200363:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca4431a1200 x1623974274135152/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200367:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.200369:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.200463:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df8000 x1623974274135168 msgsize 272
00010000:00000040:5.0:1550079902.200463:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265408
00000004:00000040:5.0:1550079902.200464:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.200464:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265409
00010000:00010000:5.0:1550079902.200466:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca359fcda00/0x6bcd99f6a8011ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265409 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0ca60d expref: 265417 pid: 21296 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.200470:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265408
00000020:00000040:36.0:1550079902.200471:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200471:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000020:00000040:5.0:1550079902.200471:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca359fcda00 with handle 0x6bcd99f6a8011ae3 from hash
00010000:00000040:5.0:1550079902.200472:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265407
00000100:00000040:36.0:1550079902.200473:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00010000:00000040:5.0:1550079902.200473:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265408
00010000:00010000:5.0:1550079902.200474:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca359fcda00/0x6bcd99f6a8011ae3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265408 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0ca60d expref: 265417 pid: 21296 timeout: 62419 lvb_type: 0
00000100:00000040:36.0:1550079902.200476:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200477:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df8000 x1623974274135168/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00000040:5.0:1550079902.200477:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265407
00010000:00000040:5.0:1550079902.200478:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265406
00010000:00000040:5.0:1550079902.200478:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265414
00000020:00000040:5.0:1550079902.200479:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265416
00000001:00000040:5.0:1550079902.200480:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 219
00000040:00000040:36.0:1550079902.200484:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200492:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200493:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135168
00000100:00000040:36.0:1550079902.200495:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200497:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200503:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200504:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df8000 x1623974274135168/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200508:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.200510:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.200602:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df8300 x1623974274135184 msgsize 272
00000020:00000040:36.0:1550079902.200608:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200609:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.200611:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.200614:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200615:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df8300 x1623974274135184/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.200622:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200629:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200630:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135184
00000100:00000040:36.0:1550079902.200632:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200634:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200640:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200642:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df8300 x1623974274135184/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200649:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.200651:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.200744:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df8600 x1623974274135200 msgsize 272
00000020:00000040:36.0:1550079902.200751:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200752:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.200753:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.200756:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200757:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df8600 x1623974274135200/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.200764:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200770:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200771:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135200
00000100:00000040:36.0:1550079902.200774:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200775:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200781:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200783:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df8600 x1623974274135200/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200787:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00010000:00000040:20.0:1550079902.200787:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22272
00000020:00000040:36.0:1550079902.200788:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000004:00000040:20.0:1550079902.200788:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.200790:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc457f45340 with handle 0x6bcd99f6a71acfd2 from hash
00010000:00000040:20.0:1550079902.200791:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22271
00010000:00000040:20.0:1550079902.200792:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22272
00010000:00010000:20.0:1550079902.200793:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc457f45340/0x6bcd99f6a71acfd2 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22272 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a557be expref: 22272 pid: 20532 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.200796:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22271
00010000:00000040:20.0:1550079902.200797:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22270
00010000:00000040:20.0:1550079902.200797:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22270
00000020:00000040:20.0:1550079902.200798:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22271
00000001:00000040:20.0:1550079902.200799:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 172
00000100:00000040:32.0:1550079902.200882:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df8900 x1623974274135216 msgsize 272
00000020:00000040:36.0:1550079902.200889:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.200890:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.200892:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.200895:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.200897:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df8900 x1623974274135216/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.200904:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.200909:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.200910:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135216
00000100:00000040:36.0:1550079902.200912:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200914:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200921:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.200922:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df8900 x1623974274135216/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.200926:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.200928:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.201019:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df8c00 x1623974274135232 msgsize 272
00000020:00000040:36.0:1550079902.201026:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201027:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201029:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201032:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201033:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df8c00 x1623974274135232/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201040:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201048:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201048:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135232
00000100:00000040:36.0:1550079902.201051:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201052:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201058:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201060:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df8c00 x1623974274135232/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.201063:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201065:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.201155:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df8f00 x1623974274135248 msgsize 272
00000020:00000040:36.0:1550079902.201162:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201163:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201164:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201167:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201169:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df8f00 x1623974274135248/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201175:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201182:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201183:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135248
00000100:00000040:36.0:1550079902.201185:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201187:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201192:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201194:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df8f00 x1623974274135248/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.201198:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201199:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00010000:00000040:5.0:1550079902.201237:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265407
00000004:00000040:5.0:1550079902.201238:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.201239:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265408
00010000:00010000:5.0:1550079902.201241:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd45b974c80/0x6bcd99f6a7dbe0a2 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265408 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff05a60d expref: 265416 pid: 21458 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.201245:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265407
00000020:00000040:5.0:1550079902.201246:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45b974c80 with handle 0x6bcd99f6a7dbe0a2 from hash
00010000:00000040:5.0:1550079902.201247:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265406
00010000:00000040:5.0:1550079902.201248:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265407
00010000:00010000:5.0:1550079902.201250:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45b974c80/0x6bcd99f6a7dbe0a2 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265407 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff05a60d expref: 265416 pid: 21458 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.201253:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265406
00010000:00000040:5.0:1550079902.201253:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265405
00010000:00000040:5.0:1550079902.201254:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265413
00000020:00000040:5.0:1550079902.201255:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265415
00000001:00000040:5.0:1550079902.201256:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 220
00000100:00000040:32.0:1550079902.201291:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df9200 x1623974274135264 msgsize 272
00000020:00000040:36.0:1550079902.201297:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201298:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201300:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201303:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201305:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df9200 x1623974274135264/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201312:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201321:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201322:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135264
00000100:00000040:36.0:1550079902.201324:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201325:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201331:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201333:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df9200 x1623974274135264/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.201337:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201339:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.201430:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df9500 x1623974274135280 msgsize 272
00000020:00000040:36.0:1550079902.201437:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201437:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201439:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201442:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201443:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df9500 x1623974274135280/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201450:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201457:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201457:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135280
00000100:00000040:36.0:1550079902.201460:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201461:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201467:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201468:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df9500 x1623974274135280/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.201472:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201474:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.201563:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df9800 x1623974274135296 msgsize 272
00000020:00000040:36.0:1550079902.201570:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201571:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201573:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201575:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201577:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df9800 x1623974274135296/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201583:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201590:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201591:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135296
00000100:00000040:36.0:1550079902.201593:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201595:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201601:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201602:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df9800 x1623974274135296/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.201606:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201608:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00000100:00000040:32.0:1550079902.201699:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df9b00 x1623974274135312 msgsize 272
00000020:00000040:36.0:1550079902.201706:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201707:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201708:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201711:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201712:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df9b00 x1623974274135312/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201722:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201728:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201729:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135312
00000100:00000040:36.0:1550079902.201731:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201733:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201738:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201740:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df9b00 x1623974274135312/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:36.0:1550079902.201743:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201745:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00010000:00000040:20.0:1550079902.201763:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22271
00000004:00000040:20.0:1550079902.201764:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.201765:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca023870900 with handle 0x6bcd99f6a96cce8b from hash
00010000:00000040:20.0:1550079902.201766:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22270
00010000:00000040:20.0:1550079902.201767:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22271
00010000:00010000:20.0:1550079902.201769:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca023870900/0x6bcd99f6a96cce8b lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22271 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e95fbe expref: 22271 pid: 20640 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.201772:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22270
00010000:00000040:20.0:1550079902.201772:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22269
00010000:00000040:20.0:1550079902.201773:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22269
00000020:00000040:20.0:1550079902.201774:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22270
00000001:00000040:20.0:1550079902.201775:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 173
00000100:00000040:32.0:1550079902.201845:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098df9e00 x1623974274135328 msgsize 272
00000020:00000040:36.0:1550079902.201852:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa13c45
00000020:00000040:36.0:1550079902.201853:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482c16c00 : new refcount 38519
00000100:00000040:36.0:1550079902.201854:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +56s
00000100:00000040:36.0:1550079902.201857:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482c16c00 : new rpc_count 1
00000100:00000040:36.0:1550079902.201859:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098df9e00 x1623974274135328/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/0 e 0 to 0 dl 1550079963 ref 1 fl New:/0/ffffffff rc 0/-1
00000040:00000040:36.0:1550079902.201872:0:21809:0:(lustre_log.h:365:llog_ctxt_get()) GETting ctxt ffff9ca4f9316300 : new refcount 3
00000040:00000040:36.0:1550079902.201878:0:21809:0:(lustre_log.h:375:llog_ctxt_put()) PUTting ctxt ffff9ca4f9316300 : new refcount 2
00010000:00000040:36.0:1550079902.201879:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754596698, transno 0, xid 1623974274135328
00000100:00000040:36.0:1550079902.201881:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9ca4f5df7900 refcount 6 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201883:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201889:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9ca4f5df7900 refcount 5 to 10.0.10.3@o2ib7
00000100:00000040:36.0:1550079902.201890:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098df9e00 x1623974274135328/t0(0) o502->0ccdc4e2-9749-c9a5-afb4-85874ce74d6c@10.0.10.3@o2ib7:33/0 lens 272/8440 e 0 to 0 dl 1550079963 ref 1 fl Interpret:/0/0 rc -5/-5
00000100:00000040:36.0:1550079902.201894:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482c16c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.201895:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482c16c00 : new refcount 38518
00010000:00000040:5.0:1550079902.202012:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265406
00000004:00000040:5.0:1550079902.202012:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.202013:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265407
00010000:00010000:5.0:1550079902.202015:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a52d86c0/0x6bcd99f6a7a793cb lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265407 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefea60d expref: 265415 pid: 21727 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.202018:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265406
00000020:00000040:5.0:1550079902.202020:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4a52d86c0 with handle 0x6bcd99f6a7a793cb from hash
00010000:00000040:5.0:1550079902.202021:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265405
00010000:00000040:5.0:1550079902.202021:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265406
00010000:00010000:5.0:1550079902.202023:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a52d86c0/0x6bcd99f6a7a793cb lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265406 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefea60d expref: 265415 pid: 21727 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.202026:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265405
00010000:00000040:5.0:1550079902.202026:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265404
00010000:00000040:5.0:1550079902.202027:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265412
00000020:00000040:5.0:1550079902.202029:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265414
00000001:00000040:5.0:1550079902.202030:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 221
00010000:00000040:20.0:1550079902.202739:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22270
00000004:00000040:20.0:1550079902.202740:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.202741:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3a4b3dc40 with handle 0x6bcd99f6a918b8c0 from hash
00010000:00000040:20.0:1550079902.202742:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22269
00010000:00000040:20.0:1550079902.202743:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22270
00010000:00010000:20.0:1550079902.202745:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3a4b3dc40/0x6bcd99f6a918b8c0 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22270 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e25fbe expref: 22270 pid: 21811 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.202748:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22269
00010000:00000040:20.0:1550079902.202749:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22268
00010000:00000040:20.0:1550079902.202749:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22268
00000020:00000040:20.0:1550079902.202750:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22269
00000001:00000040:20.0:1550079902.202751:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 174
00010000:00000040:5.0:1550079902.202782:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265405
00000004:00000040:5.0:1550079902.202782:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.202783:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265406
00010000:00010000:5.0:1550079902.202785:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb41c07aac0/0x6bcd99f6a7830cea lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265406 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef7a60d expref: 265414 pid: 21456 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.202788:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265405
00000020:00000040:5.0:1550079902.202789:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb41c07aac0 with handle 0x6bcd99f6a7830cea from hash
00010000:00000040:5.0:1550079902.202790:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265404
00010000:00000040:5.0:1550079902.202791:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265405
00010000:00010000:5.0:1550079902.202792:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb41c07aac0/0x6bcd99f6a7830cea lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265405 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef7a60d expref: 265414 pid: 21456 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.202796:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265404
00010000:00000040:5.0:1550079902.202796:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265403
00010000:00000040:5.0:1550079902.202797:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265411
00000020:00000040:5.0:1550079902.202798:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265413
00000001:00000040:5.0:1550079902.202799:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 222
00010000:00000040:5.0:1550079902.203555:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265404
00000004:00000040:5.0:1550079902.203556:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.203557:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265405
00010000:00010000:5.0:1550079902.203558:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46901cec0/0x6bcd99f6a7555c4c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265405 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef0a60d expref: 265413 pid: 21833 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.203561:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265404
00000020:00000040:5.0:1550079902.203563:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46901cec0 with handle 0x6bcd99f6a7555c4c from hash
00010000:00000040:5.0:1550079902.203564:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265403
00010000:00000040:5.0:1550079902.203564:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265404
00010000:00010000:5.0:1550079902.203566:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46901cec0/0x6bcd99f6a7555c4c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265404 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef0a60d expref: 265413 pid: 21833 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.203569:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265403
00010000:00000040:5.0:1550079902.203570:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265402
00010000:00000040:5.0:1550079902.203570:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265410
00000020:00000040:5.0:1550079902.203571:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265412
00000001:00000040:5.0:1550079902.203572:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 223
00010000:00000040:20.0:1550079902.203716:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22269
00000004:00000040:20.0:1550079902.203717:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.203719:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9fc07ee9c0 with handle 0x6bcd99f6a8e58586 from hash
00010000:00000040:20.0:1550079902.203720:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22268
00010000:00000040:20.0:1550079902.203721:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22269
00010000:00010000:20.0:1550079902.203722:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9fc07ee9c0/0x6bcd99f6a8e58586 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22269 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52db5fbe expref: 22269 pid: 21845 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.203725:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22268
00010000:00000040:20.0:1550079902.203726:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22267
00010000:00000040:20.0:1550079902.203727:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22267
00000020:00000040:20.0:1550079902.203728:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22268
00000001:00000040:20.0:1550079902.203729:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 175
00010000:00000040:5.0:1550079902.204324:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265403
00000004:00000040:5.0:1550079902.204325:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.204325:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265404
00010000:00010000:5.0:1550079902.204327:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d57e769c0/0x6bcd99f6a736e002 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265404 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee9a60d expref: 265412 pid: 21811 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.204331:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265403
00000020:00000040:5.0:1550079902.204332:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d57e769c0 with handle 0x6bcd99f6a736e002 from hash
00010000:00000040:5.0:1550079902.204333:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265402
00010000:00000040:5.0:1550079902.204334:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265403
00010000:00010000:5.0:1550079902.204335:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d57e769c0/0x6bcd99f6a736e002 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265403 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee9a60d expref: 265412 pid: 21811 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.204338:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265402
00010000:00000040:5.0:1550079902.204339:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265401
00010000:00000040:5.0:1550079902.204339:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265409
00000020:00000040:5.0:1550079902.204340:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265411
00000001:00000040:5.0:1550079902.204341:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 224
00010000:00000040:20.0:1550079902.204694:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22268
00000004:00000040:20.0:1550079902.204695:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.204697:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4088f3600 with handle 0x6bcd99f6a89cf792 from hash
00010000:00000040:20.0:1550079902.204698:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22267
00010000:00000040:20.0:1550079902.204699:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22268
00010000:00010000:20.0:1550079902.204701:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4088f3600/0x6bcd99f6a89cf792 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22268 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d45fbe expref: 22268 pid: 20808 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.204704:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22267
00010000:00000040:20.0:1550079902.204705:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22266
00010000:00000040:20.0:1550079902.204705:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22266
00000020:00000040:20.0:1550079902.204706:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22267
00000001:00000040:20.0:1550079902.204707:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 176
00010000:00000040:5.0:1550079902.205098:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265402
00000004:00000040:5.0:1550079902.205099:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.205099:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265403
00010000:00010000:5.0:1550079902.205101:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd49192e540/0x6bcd99f6a70ab518 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265403 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee2a60d expref: 265411 pid: 20793 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.205105:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265402
00000020:00000040:5.0:1550079902.205106:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd49192e540 with handle 0x6bcd99f6a70ab518 from hash
00010000:00000040:5.0:1550079902.205107:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265401
00010000:00000040:5.0:1550079902.205108:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265402
00010000:00010000:5.0:1550079902.205109:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd49192e540/0x6bcd99f6a70ab518 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265402 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee2a60d expref: 265411 pid: 20793 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.205113:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265401
00010000:00000040:5.0:1550079902.205113:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265400
00010000:00000040:5.0:1550079902.205114:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265408
00000020:00000040:5.0:1550079902.205115:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265410
00000001:00000040:5.0:1550079902.205116:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 225
00010000:00000040:20.0:1550079902.205672:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22267
00000004:00000040:20.0:1550079902.205673:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.205674:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e1c24a880 with handle 0x6bcd99f6a81c726c from hash
00010000:00000040:20.0:1550079902.205676:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22266
00010000:00000040:20.0:1550079902.205676:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22267
00010000:00010000:20.0:1550079902.205678:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e1c24a880/0x6bcd99f6a81c726c lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22267 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c65fbe expref: 22267 pid: 21318 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.205681:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22266
00010000:00000040:20.0:1550079902.205682:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22265
00010000:00000040:20.0:1550079902.205682:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22265
00000020:00000040:20.0:1550079902.205683:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22266
00000001:00000040:20.0:1550079902.205684:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 177
00010000:00000040:5.0:1550079902.205873:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265401
00000004:00000040:5.0:1550079902.205874:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.205875:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265402
00010000:00010000:5.0:1550079902.205877:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3dd44bf00/0x6bcd99f6a6e88336 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265402 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedba60d expref: 265410 pid: 20581 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.205880:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265401
00000020:00000040:5.0:1550079902.205881:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3dd44bf00 with handle 0x6bcd99f6a6e88336 from hash
00010000:00000040:5.0:1550079902.205882:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265400
00010000:00000040:5.0:1550079902.205883:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265401
00010000:00010000:5.0:1550079902.205884:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3dd44bf00/0x6bcd99f6a6e88336 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265401 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedba60d expref: 265410 pid: 20581 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.205887:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265400
00010000:00000040:5.0:1550079902.205888:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265399
00010000:00000040:5.0:1550079902.205889:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265407
00000020:00000040:5.0:1550079902.205890:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265409
00000001:00000040:5.0:1550079902.205891:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 226
00010000:00000040:5.0:1550079902.206643:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265400
00000004:00000040:5.0:1550079902.206644:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.206645:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265401
00010000:00010000:5.0:1550079902.206646:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc4642e2640/0x6bcd99f6a6bedbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265401 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed4a60d expref: 265409 pid: 21800 timeout: 62426 lvb_type: 0
00010000:00000040:20.0:1550079902.206650:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22266
00010000:00000040:5.0:1550079902.206650:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265400
00000004:00000040:20.0:1550079902.206651:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.206652:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc45bae5e80 with handle 0x6bcd99f6a7d3bc15 from hash
00000020:00000040:5.0:1550079902.206652:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4642e2640 with handle 0x6bcd99f6a6bedbb9 from hash
00010000:00000040:5.0:1550079902.206653:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265399
00010000:00000040:20.0:1550079902.206654:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22265
00010000:00000040:5.0:1550079902.206654:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265400
00010000:00000040:20.0:1550079902.206655:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22266
00010000:00010000:5.0:1550079902.206655:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4642e2640/0x6bcd99f6a6bedbb9 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265400 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed4a60d expref: 265409 pid: 21800 timeout: 62426 lvb_type: 0
00010000:00010000:20.0:1550079902.206657:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc45bae5e80/0x6bcd99f6a7d3bc15 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22266 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bf5fbe expref: 22266 pid: 20581 timeout: 0 lvb_type: 0
00010000:00000040:5.0:1550079902.206658:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265399
00010000:00000040:5.0:1550079902.206659:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265398
00010000:00000040:20.0:1550079902.206660:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22265
00010000:00000040:5.0:1550079902.206660:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265406
00000020:00000040:5.0:1550079902.206660:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265408
00010000:00000040:20.0:1550079902.206661:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22264
00010000:00000040:20.0:1550079902.206661:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22264
00000001:00000040:5.0:1550079902.206661:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 227
00000020:00000040:20.0:1550079902.206662:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22265
00000001:00000040:20.0:1550079902.206663:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 178
00010000:00000040:5.0:1550079902.207418:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265399
00000004:00000040:5.0:1550079902.207419:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.207420:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265400
00010000:00010000:5.0:1550079902.207421:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd46cf93840/0x6bcd99f6a6927d91 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265400 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecda60d expref: 265408 pid: 21816 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.207425:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265399
00000020:00000040:5.0:1550079902.207426:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46cf93840 with handle 0x6bcd99f6a6927d91 from hash
00010000:00000040:5.0:1550079902.207427:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265398
00010000:00000040:5.0:1550079902.207428:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265399
00010000:00010000:5.0:1550079902.207430:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46cf93840/0x6bcd99f6a6927d91 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265399 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecda60d expref: 265408 pid: 21816 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.207433:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265398
00010000:00000040:5.0:1550079902.207434:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265397
00010000:00000040:5.0:1550079902.207434:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265405
00000020:00000040:5.0:1550079902.207435:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265407
00000001:00000040:5.0:1550079902.207436:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 228
00010000:00000040:20.0:1550079902.207629:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22265
00000004:00000040:20.0:1550079902.207630:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.207631:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca35045c380 with handle 0x6bcd99f6a7a131a6 from hash
00010000:00000040:20.0:1550079902.207633:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22264
00010000:00000040:20.0:1550079902.207633:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22265
00010000:00010000:20.0:1550079902.207635:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca35045c380/0x6bcd99f6a7a131a6 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22265 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b85fbe expref: 22265 pid: 21794 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.207638:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22264
00010000:00000040:20.0:1550079902.207639:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22263
00010000:00000040:20.0:1550079902.207639:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22263
00000020:00000040:20.0:1550079902.207640:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22264
00000001:00000040:20.0:1550079902.207641:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 179
00010000:00000040:5.0:1550079902.208189:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265398
00000004:00000040:5.0:1550079902.208190:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.208191:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265399
00010000:00010000:5.0:1550079902.208193:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc40e109680/0x6bcd99f6a8949467 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265399 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3bae0d expref: 265407 pid: 21356 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.208196:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265398
00000020:00000040:5.0:1550079902.208198:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc40e109680 with handle 0x6bcd99f6a8949467 from hash
00010000:00000040:5.0:1550079902.208199:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265397
00010000:00000040:5.0:1550079902.208200:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265398
00010000:00010000:5.0:1550079902.208201:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc40e109680/0x6bcd99f6a8949467 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265398 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff3bae0d expref: 265407 pid: 21356 timeout: 62413 lvb_type: 0
00010000:00000040:5.0:1550079902.208204:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265397
00010000:00000040:5.0:1550079902.208204:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265396
00010000:00000040:5.0:1550079902.208205:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265404
00000020:00000040:5.0:1550079902.208206:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265406
00000001:00000040:5.0:1550079902.208207:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 229
00010000:00000040:20.0:1550079902.208606:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22264
00000004:00000040:20.0:1550079902.208607:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.208609:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3f83a1440 with handle 0x6bcd99f6a769ec99 from hash
00010000:00000040:20.0:1550079902.208610:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22263
00010000:00000040:20.0:1550079902.208611:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22264
00010000:00010000:20.0:1550079902.208613:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f83a1440/0x6bcd99f6a769ec99 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22264 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b15fbe expref: 22264 pid: 20820 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.208616:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22263
00010000:00000040:20.0:1550079902.208617:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22262
00010000:00000040:20.0:1550079902.208618:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22262
00000020:00000040:20.0:1550079902.208618:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22263
00000001:00000040:20.0:1550079902.208619:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 180
00010000:00000040:5.0:1550079902.208963:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265397
00000004:00000040:5.0:1550079902.208964:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.208965:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265398
00010000:00010000:5.0:1550079902.208966:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d5690e0c0/0x6bcd99f6a87965db lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265398 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff34ae0d expref: 265406 pid: 21296 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.208970:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265397
00000020:00000040:5.0:1550079902.208972:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d5690e0c0 with handle 0x6bcd99f6a87965db from hash
00010000:00000040:5.0:1550079902.208973:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265396
00010000:00000040:5.0:1550079902.208974:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265397
00010000:00010000:5.0:1550079902.208975:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d5690e0c0/0x6bcd99f6a87965db lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265397 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff34ae0d expref: 265406 pid: 21296 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.208978:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265396
00010000:00000040:5.0:1550079902.208979:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265395
00010000:00000040:5.0:1550079902.208979:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265403
00000020:00000040:5.0:1550079902.208980:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265405
00000001:00000040:5.0:1550079902.208982:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 230
00010000:00000040:20.0:1550079902.209585:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22263
00000004:00000040:20.0:1550079902.209586:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.209587:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9dca5ccc80 with handle 0x6bcd99f6a74360a6 from hash
00010000:00000040:20.0:1550079902.209588:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22262
00010000:00000040:20.0:1550079902.209589:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22263
00010000:00010000:20.0:1550079902.209591:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9dca5ccc80/0x6bcd99f6a74360a6 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22263 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52aa5fbe expref: 22263 pid: 21809 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.209594:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22262
00010000:00000040:20.0:1550079902.209595:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22261
00010000:00000040:20.0:1550079902.209595:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22261
00000020:00000040:20.0:1550079902.209596:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22262
00000001:00000040:20.0:1550079902.209597:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 181
00010000:00000040:5.0:1550079902.209734:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265396
00000004:00000040:5.0:1550079902.209735:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.209736:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265397
00010000:00010000:5.0:1550079902.209737:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc40fe56300/0x6bcd99f6a8615dec lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265397 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2dae0d expref: 265405 pid: 21855 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.209741:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265396
00000020:00000040:5.0:1550079902.209742:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc40fe56300 with handle 0x6bcd99f6a8615dec from hash
00010000:00000040:5.0:1550079902.209743:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265395
00010000:00000040:5.0:1550079902.209744:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265396
00010000:00010000:5.0:1550079902.209745:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc40fe56300/0x6bcd99f6a8615dec lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265396 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2dae0d expref: 265405 pid: 21855 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.209748:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265395
00010000:00000040:5.0:1550079902.209749:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265394
00010000:00000040:5.0:1550079902.209749:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265402
00000020:00000040:5.0:1550079902.209751:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265404
00000001:00000040:5.0:1550079902.209752:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 231
00010000:00000040:5.0:1550079902.210508:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265395
00000004:00000040:5.0:1550079902.210509:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.210509:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265396
00010000:00010000:5.0:1550079902.210511:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb408f6cc80/0x6bcd99f6a84a5c0d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265396 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff26ae0d expref: 265404 pid: 21456 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.210514:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265395
00000020:00000040:5.0:1550079902.210515:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb408f6cc80 with handle 0x6bcd99f6a84a5c0d from hash
00010000:00000040:5.0:1550079902.210516:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265394
00010000:00000040:5.0:1550079902.210517:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265395
00010000:00010000:5.0:1550079902.210518:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb408f6cc80/0x6bcd99f6a84a5c0d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265395 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff26ae0d expref: 265404 pid: 21456 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.210521:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265394
00010000:00000040:5.0:1550079902.210522:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265393
00010000:00000040:5.0:1550079902.210522:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265401
00000020:00000040:5.0:1550079902.210523:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265403
00000001:00000040:5.0:1550079902.210524:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 232
00010000:00000040:20.0:1550079902.210562:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22262
00000004:00000040:20.0:1550079902.210563:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.210564:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e8370b40 with handle 0x6bcd99f6a70c69f7 from hash
00010000:00000040:20.0:1550079902.210566:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22261
00010000:00000040:20.0:1550079902.210567:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22262
00010000:00010000:20.0:1550079902.210568:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e8370b40/0x6bcd99f6a70c69f7 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22262 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a35fbe expref: 22262 pid: 20532 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.210575:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22261
00010000:00000040:20.0:1550079902.210575:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22260
00010000:00000040:20.0:1550079902.210576:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22260
00000020:00000040:20.0:1550079902.210577:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22261
00000001:00000040:20.0:1550079902.210578:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 182
00010000:00000040:5.0:1550079902.211275:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265394
00000004:00000040:5.0:1550079902.211276:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.211277:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265395
00010000:00010000:5.0:1550079902.211279:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd47cbfca40/0x6bcd99f6a838eb25 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265395 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1fae0d expref: 265403 pid: 21811 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.211282:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265394
00000020:00000040:5.0:1550079902.211284:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd47cbfca40 with handle 0x6bcd99f6a838eb25 from hash
00010000:00000040:5.0:1550079902.211285:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265393
00010000:00000040:5.0:1550079902.211286:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265394
00010000:00010000:5.0:1550079902.211288:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd47cbfca40/0x6bcd99f6a838eb25 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265394 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1fae0d expref: 265403 pid: 21811 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.211291:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265393
00010000:00000040:5.0:1550079902.211291:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265392
00010000:00000040:5.0:1550079902.211292:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265400
00000020:00000040:5.0:1550079902.211293:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265402
00000001:00000040:5.0:1550079902.211294:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 233
00010000:00000040:20.0:1550079902.211541:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22261
00000004:00000040:20.0:1550079902.211542:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.211544:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb432ee0fc0 with handle 0x6bcd99f6a953cc55 from hash
00010000:00000040:20.0:1550079902.211545:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22260
00010000:00000040:20.0:1550079902.211546:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22261
00010000:00010000:20.0:1550079902.211548:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb432ee0fc0/0x6bcd99f6a953cc55 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22261 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e767be expref: 22261 pid: 21826 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.211551:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22260
00010000:00000040:20.0:1550079902.211552:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22259
00010000:00000040:20.0:1550079902.211552:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22259
00000020:00000040:20.0:1550079902.211553:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22260
00000001:00000040:20.0:1550079902.211554:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 183
00010000:00000040:5.0:1550079902.212050:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265393
00000004:00000040:5.0:1550079902.212051:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.212051:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265394
00010000:00010000:5.0:1550079902.212053:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb459780240/0x6bcd99f6a8254ceb lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265394 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff18ae0d expref: 265402 pid: 21884 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.212056:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265393
00000020:00000040:5.0:1550079902.212058:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb459780240 with handle 0x6bcd99f6a8254ceb from hash
00010000:00000040:5.0:1550079902.212059:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265392
00010000:00000040:5.0:1550079902.212060:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265393
00010000:00010000:5.0:1550079902.212061:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb459780240/0x6bcd99f6a8254ceb lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265393 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff18ae0d expref: 265402 pid: 21884 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.212064:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265392
00010000:00000040:5.0:1550079902.212065:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265391
00010000:00000040:5.0:1550079902.212066:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265399
00000020:00000040:5.0:1550079902.212066:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265401
00000001:00000040:5.0:1550079902.212068:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 234
00010000:00000040:20.0:1550079902.212519:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22260
00000004:00000040:20.0:1550079902.212520:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.212521:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc4089dba80 with handle 0x6bcd99f6a90a4452 from hash
00010000:00000040:20.0:1550079902.212523:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22259
00010000:00000040:20.0:1550079902.212524:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22260
00010000:00010000:20.0:1550079902.212525:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc4089dba80/0x6bcd99f6a90a4452 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22260 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e067be expref: 22260 pid: 21457 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.212528:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22259
00010000:00000040:20.0:1550079902.212529:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22258
00010000:00000040:20.0:1550079902.212530:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22258
00000020:00000040:20.0:1550079902.212531:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22259
00000001:00000040:20.0:1550079902.212532:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 184
00010000:00000040:5.0:1550079902.212819:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265392
00000004:00000040:5.0:1550079902.212820:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.212821:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265393
00010000:00010000:5.0:1550079902.212823:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc430636e40/0x6bcd99f6a80eee90 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265393 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff11ae0d expref: 265401 pid: 21855 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.212827:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265392
00000020:00000040:5.0:1550079902.212828:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc430636e40 with handle 0x6bcd99f6a80eee90 from hash
00010000:00000040:5.0:1550079902.212829:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265391
00010000:00000040:5.0:1550079902.212830:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265392
00010000:00010000:5.0:1550079902.212831:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc430636e40/0x6bcd99f6a80eee90 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265392 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff11ae0d expref: 265401 pid: 21855 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.212834:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265391
00010000:00000040:5.0:1550079902.212835:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265390
00010000:00000040:5.0:1550079902.212836:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265398
00000020:00000040:5.0:1550079902.212837:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265400
00000001:00000040:5.0:1550079902.212838:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 235
00010000:00000040:20.0:1550079902.213496:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22259
00000004:00000040:20.0:1550079902.213497:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.213498:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd466eaf2c0 with handle 0x6bcd99f6a8cf7ac9 from hash
00010000:00000040:20.0:1550079902.213500:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22258
00010000:00000040:20.0:1550079902.213500:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22259
00010000:00010000:20.0:1550079902.213502:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd466eaf2c0/0x6bcd99f6a8cf7ac9 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22259 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d967be expref: 22259 pid: 21826 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.213505:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22258
00010000:00000040:20.0:1550079902.213506:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22257
00010000:00000040:20.0:1550079902.213506:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22257
00000020:00000040:20.0:1550079902.213507:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22258
00000001:00000040:20.0:1550079902.213508:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 185
00010000:00000040:5.0:1550079902.213593:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265391
00000004:00000040:5.0:1550079902.213594:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.213595:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265392
00010000:00010000:5.0:1550079902.213597:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc422fdd580/0x6bcd99f6a7fb1f9c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265392 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0aae0d expref: 265400 pid: 21800 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.213600:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265391
00000020:00000040:5.0:1550079902.213602:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc422fdd580 with handle 0x6bcd99f6a7fb1f9c from hash
00010000:00000040:5.0:1550079902.213603:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265390
00010000:00000040:5.0:1550079902.213604:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265391
00010000:00010000:5.0:1550079902.213605:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc422fdd580/0x6bcd99f6a7fb1f9c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265391 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0aae0d expref: 265400 pid: 21800 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.213608:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265390
00010000:00000040:5.0:1550079902.213608:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265389
00010000:00000040:5.0:1550079902.213609:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265397
00000020:00000040:5.0:1550079902.213611:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265399
00000001:00000040:5.0:1550079902.213612:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 236
00010000:00000040:5.0:1550079902.214367:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265390
00000004:00000040:5.0:1550079902.214368:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.214369:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265391
00010000:00010000:5.0:1550079902.214370:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca452ab6780/0x6bcd99f6a7d1c255 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265391 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff03ae0d expref: 265399 pid: 21067 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.214373:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265390
00000020:00000040:5.0:1550079902.214375:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca452ab6780 with handle 0x6bcd99f6a7d1c255 from hash
00010000:00000040:5.0:1550079902.214376:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265389
00010000:00000040:5.0:1550079902.214376:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265390
00010000:00010000:5.0:1550079902.214377:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca452ab6780/0x6bcd99f6a7d1c255 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265390 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff03ae0d expref: 265399 pid: 21067 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.214380:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265389
00010000:00000040:5.0:1550079902.214381:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265388
00010000:00000040:5.0:1550079902.214382:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265396
00000020:00000040:5.0:1550079902.214382:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265398
00000001:00000040:5.0:1550079902.214383:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 237
00010000:00000040:20.0:1550079902.214472:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22258
00000004:00000040:20.0:1550079902.214473:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.214474:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd481d45580 with handle 0x6bcd99f6a89127b5 from hash
00010000:00000040:20.0:1550079902.214476:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22257
00010000:00000040:20.0:1550079902.214476:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22258
00010000:00010000:20.0:1550079902.214478:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd481d45580/0x6bcd99f6a89127b5 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22258 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d267be expref: 22258 pid: 21861 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.214481:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22257
00010000:00000040:20.0:1550079902.214482:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22256
00010000:00000040:20.0:1550079902.214483:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22256
00000020:00000040:20.0:1550079902.214483:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22257
00000001:00000040:20.0:1550079902.214484:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 186
00010000:00000040:5.0:1550079902.215136:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265389
00000004:00000040:5.0:1550079902.215136:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.215137:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265390
00010000:00010000:5.0:1550079902.215139:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3d0854380/0x6bcd99f6a798b824 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265390 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefcae0d expref: 265398 pid: 21884 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.215142:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265389
00000020:00000040:5.0:1550079902.215143:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3d0854380 with handle 0x6bcd99f6a798b824 from hash
00010000:00000040:5.0:1550079902.215144:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265388
00010000:00000040:5.0:1550079902.215145:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265389
00010000:00010000:5.0:1550079902.215147:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3d0854380/0x6bcd99f6a798b824 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265389 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefcae0d expref: 265398 pid: 21884 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.215150:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265388
00010000:00000040:5.0:1550079902.215151:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265387
00010000:00000040:5.0:1550079902.215151:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265395
00000020:00000040:5.0:1550079902.215152:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265397
00000001:00000040:5.0:1550079902.215153:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 238
00010000:00000040:20.0:1550079902.215448:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22257
00000004:00000040:20.0:1550079902.215450:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.215451:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d49c886c0 with handle 0x6bcd99f6a8122cfe from hash
00010000:00000040:20.0:1550079902.215452:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22256
00010000:00000040:20.0:1550079902.215453:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22257
00010000:00010000:20.0:1550079902.215455:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d49c886c0/0x6bcd99f6a8122cfe lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22257 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c467be expref: 22257 pid: 21346 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.215458:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22256
00010000:00000040:20.0:1550079902.215459:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22255
00010000:00000040:20.0:1550079902.215459:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22255
00000020:00000040:20.0:1550079902.215460:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22256
00000001:00000040:20.0:1550079902.215461:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 187
00010000:00000040:5.0:1550079902.215910:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265388
00000004:00000040:5.0:1550079902.215911:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.215911:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265389
00010000:00010000:5.0:1550079902.215913:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca410e98240/0x6bcd99f6a77603e9 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265389 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef5ae0d expref: 265397 pid: 20774 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.215917:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265388
00000020:00000040:5.0:1550079902.215918:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca410e98240 with handle 0x6bcd99f6a77603e9 from hash
00010000:00000040:5.0:1550079902.215920:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265387
00010000:00000040:5.0:1550079902.215920:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265388
00010000:00010000:5.0:1550079902.215921:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca410e98240/0x6bcd99f6a77603e9 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265388 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef5ae0d expref: 265397 pid: 20774 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.215925:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265387
00010000:00000040:5.0:1550079902.215925:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265386
00010000:00000040:5.0:1550079902.215926:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265394
00000020:00000040:5.0:1550079902.215927:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265396
00000001:00000040:5.0:1550079902.215928:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 239
00010000:00000040:20.0:1550079902.216425:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22256
00000004:00000040:20.0:1550079902.216426:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.216427:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3f54bd580 with handle 0x6bcd99f6a7c12010 from hash
00010000:00000040:20.0:1550079902.216428:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22255
00010000:00000040:20.0:1550079902.216429:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22256
00010000:00010000:20.0:1550079902.216431:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3f54bd580/0x6bcd99f6a7c12010 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22256 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bd67be expref: 22256 pid: 21739 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.216434:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22255
00010000:00000040:20.0:1550079902.216435:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22254
00010000:00000040:20.0:1550079902.216435:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22254
00000020:00000040:20.0:1550079902.216436:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22255
00000001:00000040:20.0:1550079902.216437:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 188
00010000:00000040:5.0:1550079902.216680:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265387
00000004:00000040:5.0:1550079902.216681:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.216682:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265388
00010000:00010000:5.0:1550079902.216683:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd47c331f80/0x6bcd99f6a74c0b8a lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265388 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feeeae0d expref: 265396 pid: 20644 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.216687:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265387
00000020:00000040:5.0:1550079902.216689:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd47c331f80 with handle 0x6bcd99f6a74c0b8a from hash
00010000:00000040:5.0:1550079902.216690:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265386
00010000:00000040:5.0:1550079902.216691:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265387
00010000:00010000:5.0:1550079902.216692:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd47c331f80/0x6bcd99f6a74c0b8a lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265387 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feeeae0d expref: 265396 pid: 20644 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.216695:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265386
00010000:00000040:5.0:1550079902.216696:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265385
00010000:00000040:5.0:1550079902.216696:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265393
00000020:00000040:5.0:1550079902.216697:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265395
00000001:00000040:5.0:1550079902.216698:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 240
00010000:00000040:20.0:1550079902.217402:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22255
00000004:00000040:20.0:1550079902.217403:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.217404:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc40a1df500 with handle 0x6bcd99f6a795a5fb from hash
00010000:00000040:20.0:1550079902.217406:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22254
00010000:00000040:20.0:1550079902.217406:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22255
00010000:00010000:20.0:1550079902.217409:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc40a1df500/0x6bcd99f6a795a5fb lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22255 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b667be expref: 22255 pid: 21803 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.217412:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22254
00010000:00000040:20.0:1550079902.217412:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22253
00010000:00000040:20.0:1550079902.217413:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22253
00000020:00000040:20.0:1550079902.217414:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22254
00000001:00000040:20.0:1550079902.217415:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 189
00010000:00000040:5.0:1550079902.217454:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265386
00000004:00000040:5.0:1550079902.217455:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.217456:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265387
00010000:00010000:5.0:1550079902.217458:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d8ba28b40/0x6bcd99f6a7277376 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265387 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee7ae0d expref: 265395 pid: 21725 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.217461:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265386
00000020:00000040:5.0:1550079902.217463:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d8ba28b40 with handle 0x6bcd99f6a7277376 from hash
00010000:00000040:5.0:1550079902.217464:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265385
00010000:00000040:5.0:1550079902.217465:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265386
00010000:00010000:5.0:1550079902.217466:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d8ba28b40/0x6bcd99f6a7277376 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265386 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee7ae0d expref: 265395 pid: 21725 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.217469:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265385
00010000:00000040:5.0:1550079902.217470:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265384
00010000:00000040:5.0:1550079902.217470:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265392
00000020:00000040:5.0:1550079902.217472:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265394
00000001:00000040:5.0:1550079902.217473:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 241
00010000:00000040:5.0:1550079902.218229:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265385
00000004:00000040:5.0:1550079902.218230:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.218230:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265386
00010000:00010000:5.0:1550079902.218232:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4663c1f80/0x6bcd99f6a702eefd lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265386 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee0ae0d expref: 265394 pid: 21826 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.218235:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265385
00000020:00000040:5.0:1550079902.218236:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4663c1f80 with handle 0x6bcd99f6a702eefd from hash
00010000:00000040:5.0:1550079902.218237:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265384
00010000:00000040:5.0:1550079902.218238:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265385
00010000:00010000:5.0:1550079902.218239:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4663c1f80/0x6bcd99f6a702eefd lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265385 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee0ae0d expref: 265394 pid: 21826 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.218242:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265384
00010000:00000040:5.0:1550079902.218243:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265383
00010000:00000040:5.0:1550079902.218243:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265391
00000020:00000040:5.0:1550079902.218244:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265393
00000001:00000040:5.0:1550079902.218245:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 242
00010000:00000040:20.0:1550079902.218379:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22254
00000004:00000040:20.0:1550079902.218380:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.218382:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd452a73a80 with handle 0x6bcd99f6a75aa4db from hash
00010000:00000040:20.0:1550079902.218383:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22253
00010000:00000040:20.0:1550079902.218384:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22254
00010000:00010000:20.0:1550079902.218386:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd452a73a80/0x6bcd99f6a75aa4db lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22254 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52af67be expref: 22254 pid: 21859 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.218389:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22253
00010000:00000040:20.0:1550079902.218389:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22252
00010000:00000040:20.0:1550079902.218390:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22252
00000020:00000040:20.0:1550079902.218391:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22253
00000001:00000040:20.0:1550079902.218392:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 190
00010000:00000040:5.0:1550079902.218997:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265384
00000004:00000040:5.0:1550079902.218997:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.218998:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265385
00010000:00010000:5.0:1550079902.219000:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9f80dfd7c0/0x6bcd99f6a6dc8e4c lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265385 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed9ae0d expref: 265393 pid: 20527 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.219003:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265384
00000020:00000040:5.0:1550079902.219005:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f80dfd7c0 with handle 0x6bcd99f6a6dc8e4c from hash
00010000:00000040:5.0:1550079902.219006:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265383
00010000:00000040:5.0:1550079902.219006:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265384
00010000:00010000:5.0:1550079902.219008:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f80dfd7c0/0x6bcd99f6a6dc8e4c lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265384 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed9ae0d expref: 265393 pid: 20527 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.219011:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265383
00010000:00000040:5.0:1550079902.219012:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265382
00010000:00000040:5.0:1550079902.219013:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265390
00000020:00000040:5.0:1550079902.219013:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265392
00000001:00000040:5.0:1550079902.219014:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 243
00010000:00000040:20.0:1550079902.219356:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22253
00000004:00000040:20.0:1550079902.219357:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.219359:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9da3d78240 with handle 0x6bcd99f6a73337ec from hash
00010000:00000040:20.0:1550079902.219360:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22252
00010000:00000040:20.0:1550079902.219361:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22253
00010000:00010000:20.0:1550079902.219363:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9da3d78240/0x6bcd99f6a73337ec lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22253 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a867be expref: 22253 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.219366:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22252
00010000:00000040:20.0:1550079902.219367:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22251
00010000:00000040:20.0:1550079902.219368:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22251
00000020:00000040:20.0:1550079902.219369:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22252
00000001:00000040:20.0:1550079902.219370:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 191
00010000:00000040:5.0:1550079902.219766:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265383
00000004:00000040:5.0:1550079902.219767:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.219768:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265384
00010000:00010000:5.0:1550079902.219770:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd38367da00/0x6bcd99f6a6b7ae1d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265384 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed2ae0d expref: 265392 pid: 21725 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.219773:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265383
00000020:00000040:5.0:1550079902.219775:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd38367da00 with handle 0x6bcd99f6a6b7ae1d from hash
00010000:00000040:5.0:1550079902.219776:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265382
00010000:00000040:5.0:1550079902.219777:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265383
00010000:00010000:5.0:1550079902.219778:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd38367da00/0x6bcd99f6a6b7ae1d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265383 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed2ae0d expref: 265392 pid: 21725 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.219781:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265382
00010000:00000040:5.0:1550079902.219781:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265381
00010000:00000040:5.0:1550079902.219782:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265389
00000020:00000040:5.0:1550079902.219783:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265391
00000001:00000040:5.0:1550079902.219784:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 244
00010000:00000040:20.0:1550079902.220336:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22252
00000004:00000040:20.0:1550079902.220337:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.220338:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46e7d4140 with handle 0x6bcd99f6a7039043 from hash
00010000:00000040:20.0:1550079902.220339:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22251
00010000:00000040:20.0:1550079902.220340:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22252
00010000:00010000:20.0:1550079902.220342:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46e7d4140/0x6bcd99f6a7039043 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22252 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a167be expref: 22252 pid: 21826 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.220345:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22251
00010000:00000040:20.0:1550079902.220346:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22250
00010000:00000040:20.0:1550079902.220346:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22250
00000020:00000040:20.0:1550079902.220347:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22251
00000001:00000040:20.0:1550079902.220348:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 192
00010000:00000040:5.0:1550079902.220541:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265382
00000004:00000040:5.0:1550079902.220542:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.220543:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265383
00010000:00010000:5.0:1550079902.220544:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc2a53f4a40/0x6bcd99f6a681eff1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265383 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecbae0d expref: 265391 pid: 21356 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.220548:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265382
00000020:00000040:5.0:1550079902.220550:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc2a53f4a40 with handle 0x6bcd99f6a681eff1 from hash
00010000:00000040:5.0:1550079902.220551:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265381
00010000:00000040:5.0:1550079902.220551:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265382
00010000:00010000:5.0:1550079902.220553:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc2a53f4a40/0x6bcd99f6a681eff1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265382 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fecbae0d expref: 265391 pid: 21356 timeout: 62427 lvb_type: 0
00010000:00000040:5.0:1550079902.220556:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265381
00010000:00000040:5.0:1550079902.220556:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265380
00010000:00000040:5.0:1550079902.220557:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265388
00000020:00000040:5.0:1550079902.220558:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265390
00000001:00000040:5.0:1550079902.220559:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 245
00010000:00000040:20.0:1550079902.221313:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22251
00000004:00000040:20.0:1550079902.221314:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.221315:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd465427080 with handle 0x6bcd99f6a982eeb1 from hash
00010000:00000040:5.0:1550079902.221316:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265381
00010000:00000040:20.0:1550079902.221317:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22250
00010000:00000040:20.0:1550079902.221317:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22251
00000004:00000040:5.0:1550079902.221317:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.221318:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265382
00010000:00010000:20.0:1550079902.221319:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd465427080/0x6bcd99f6a982eeb1 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22251 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ec6fbe expref: 22251 pid: 21725 timeout: 0 lvb_type: 0
00010000:00010000:5.0:1550079902.221320:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca44e290000/0x6bcd99f6a88e70fc lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265382 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff39b60d expref: 265390 pid: 21792 timeout: 62414 lvb_type: 0
00010000:00000040:20.0:1550079902.221322:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22250
00010000:00000040:20.0:1550079902.221323:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22249
00010000:00000040:5.0:1550079902.221323:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265381
00010000:00000040:20.0:1550079902.221324:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22249
00000020:00000040:20.0:1550079902.221325:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22250
00000020:00000040:5.0:1550079902.221325:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca44e290000 with handle 0x6bcd99f6a88e70fc from hash
00000001:00000040:20.0:1550079902.221326:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 193
00010000:00000040:5.0:1550079902.221326:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265380
00010000:00000040:5.0:1550079902.221327:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265381
00010000:00010000:5.0:1550079902.221328:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca44e290000/0x6bcd99f6a88e70fc lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265381 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff39b60d expref: 265390 pid: 21792 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.221331:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265380
00010000:00000040:5.0:1550079902.221332:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265379
00010000:00000040:5.0:1550079902.221332:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265387
00000020:00000040:5.0:1550079902.221334:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265389
00000001:00000040:5.0:1550079902.221335:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 246
00010000:00000040:5.0:1550079902.222091:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265380
00000004:00000040:5.0:1550079902.222092:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.222093:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265381
00010000:00010000:5.0:1550079902.222094:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e663e780/0x6bcd99f6a871df7d lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265381 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff32b60d expref: 265389 pid: 21356 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.222097:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265380
00000020:00000040:5.0:1550079902.222099:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e663e780 with handle 0x6bcd99f6a871df7d from hash
00010000:00000040:5.0:1550079902.222100:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265379
00010000:00000040:5.0:1550079902.222101:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265380
00010000:00010000:5.0:1550079902.222102:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e663e780/0x6bcd99f6a871df7d lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265380 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff32b60d expref: 265389 pid: 21356 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.222105:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265379
00010000:00000040:5.0:1550079902.222106:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265378
00010000:00000040:5.0:1550079902.222106:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265386
00000020:00000040:5.0:1550079902.222107:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265388
00000001:00000040:5.0:1550079902.222107:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 247
00010000:00000040:20.0:1550079902.222290:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22250
00000004:00000040:20.0:1550079902.222290:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.222292:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc422ee3180 with handle 0x6bcd99f6a939f015 from hash
00010000:00000040:20.0:1550079902.222293:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22249
00010000:00000040:20.0:1550079902.222294:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22250
00010000:00010000:20.0:1550079902.222296:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc422ee3180/0x6bcd99f6a939f015 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22250 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e56fbe expref: 22250 pid: 21849 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.222299:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22249
00010000:00000040:20.0:1550079902.222299:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22248
00010000:00000040:20.0:1550079902.222300:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22248
00000020:00000040:20.0:1550079902.222301:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22249
00000001:00000040:20.0:1550079902.222302:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 194
00010000:00000040:5.0:1550079902.222855:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265379
00000004:00000040:5.0:1550079902.222856:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.222857:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265380
00010000:00010000:5.0:1550079902.222859:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd3f06f5580/0x6bcd99f6a85ae0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265380 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2bb60d expref: 265388 pid: 20774 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.222866:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265379
00000020:00000040:5.0:1550079902.222867:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd3f06f5580 with handle 0x6bcd99f6a85ae0d1 from hash
00010000:00000040:5.0:1550079902.222868:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265378
00010000:00000040:5.0:1550079902.222869:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265379
00010000:00010000:5.0:1550079902.222871:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd3f06f5580/0x6bcd99f6a85ae0d1 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265379 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff2bb60d expref: 265388 pid: 20774 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.222874:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265378
00010000:00000040:5.0:1550079902.222874:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265377
00010000:00000040:5.0:1550079902.222875:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265385
00000020:00000040:5.0:1550079902.222876:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265387
00000001:00000040:5.0:1550079902.222877:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 248
00010000:00000040:20.0:1550079902.223267:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22249
00000004:00000040:20.0:1550079902.223267:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.223269:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3e7a70000 with handle 0x6bcd99f6a900c186 from hash
00010000:00000040:20.0:1550079902.223270:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22248
00010000:00000040:20.0:1550079902.223271:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22249
00010000:00010000:20.0:1550079902.223272:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e7a70000/0x6bcd99f6a900c186 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22249 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52de6fbe expref: 22249 pid: 21343 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.223276:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22248
00010000:00000040:20.0:1550079902.223276:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22247
00010000:00000040:20.0:1550079902.223277:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22247
00000020:00000040:20.0:1550079902.223278:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22248
00000001:00000040:20.0:1550079902.223279:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 195
00010000:00000040:5.0:1550079902.223629:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265378
00000004:00000040:5.0:1550079902.223630:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.223631:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265379
00010000:00010000:5.0:1550079902.223633:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e42d1440/0x6bcd99f6a844b8e0 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265379 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff24b60d expref: 265387 pid: 21859 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.223636:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265378
00000020:00000040:5.0:1550079902.223637:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc3e42d1440 with handle 0x6bcd99f6a844b8e0 from hash
00010000:00000040:5.0:1550079902.223638:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265377
00010000:00000040:5.0:1550079902.223639:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265378
00010000:00010000:5.0:1550079902.223640:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc3e42d1440/0x6bcd99f6a844b8e0 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265378 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff24b60d expref: 265387 pid: 21859 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.223643:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265377
00010000:00000040:5.0:1550079902.223644:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265376
00010000:00000040:5.0:1550079902.223645:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265384
00000020:00000040:5.0:1550079902.223646:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265386
00000001:00000040:5.0:1550079902.223647:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 249
00010000:00000040:20.0:1550079902.224246:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22248
00000004:00000040:20.0:1550079902.224247:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.224248:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3c7540240 with handle 0x6bcd99f6a8b85c0a from hash
00010000:00000040:20.0:1550079902.224249:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22247
00010000:00000040:20.0:1550079902.224251:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22248
00010000:00010000:20.0:1550079902.224252:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3c7540240/0x6bcd99f6a8b85c0a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22248 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d76fbe expref: 22248 pid: 21778 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.224256:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22247
00010000:00000040:20.0:1550079902.224256:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22246
00010000:00000040:20.0:1550079902.224257:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22246
00000020:00000040:20.0:1550079902.224258:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22247
00000001:00000040:20.0:1550079902.224259:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 196
00010000:00000040:5.0:1550079902.224404:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265377
00000004:00000040:5.0:1550079902.224405:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.224406:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265378
00010000:00010000:5.0:1550079902.224407:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd479715a00/0x6bcd99f6a833a399 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265378 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1db60d expref: 265386 pid: 21711 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.224411:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265377
00000020:00000040:5.0:1550079902.224413:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd479715a00 with handle 0x6bcd99f6a833a399 from hash
00010000:00000040:5.0:1550079902.224414:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265376
00010000:00000040:5.0:1550079902.224415:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265377
00010000:00010000:5.0:1550079902.224416:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd479715a00/0x6bcd99f6a833a399 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265377 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff1db60d expref: 265386 pid: 21711 timeout: 62417 lvb_type: 0
00010000:00000040:5.0:1550079902.224419:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265376
00010000:00000040:5.0:1550079902.224420:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265375
00010000:00000040:5.0:1550079902.224420:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265383
00000020:00000040:5.0:1550079902.224421:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265385
00000001:00000040:5.0:1550079902.224422:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 250
00010000:00000040:5.0:1550079902.225178:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265376
00000004:00000040:5.0:1550079902.225179:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.225180:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265377
00010000:00010000:5.0:1550079902.225181:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd464e6cc80/0x6bcd99f6a821b4cd lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265377 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff16b60d expref: 265385 pid: 21820 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.225184:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265376
00000020:00000040:5.0:1550079902.225186:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd464e6cc80 with handle 0x6bcd99f6a821b4cd from hash
00010000:00000040:5.0:1550079902.225187:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265375
00010000:00000040:5.0:1550079902.225187:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265376
00010000:00010000:5.0:1550079902.225188:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd464e6cc80/0x6bcd99f6a821b4cd lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265376 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff16b60d expref: 265385 pid: 21820 timeout: 62418 lvb_type: 0
00010000:00000040:5.0:1550079902.225192:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265375
00010000:00000040:5.0:1550079902.225192:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265374
00010000:00000040:5.0:1550079902.225193:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265382
00000020:00000040:5.0:1550079902.225194:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265384
00000001:00000040:5.0:1550079902.225195:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 251
00010000:00000040:20.0:1550079902.225224:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22247
00000004:00000040:20.0:1550079902.225225:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.225226:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4270a9440 with handle 0x6bcd99f6a881bc87 from hash
00010000:00000040:20.0:1550079902.225227:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22246
00010000:00000040:20.0:1550079902.225228:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22247
00010000:00010000:20.0:1550079902.225230:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4270a9440/0x6bcd99f6a881bc87 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22247 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d06fbe expref: 22247 pid: 21895 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.225233:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22246
00010000:00000040:20.0:1550079902.225234:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22245
00010000:00000040:20.0:1550079902.225234:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22245
00000020:00000040:20.0:1550079902.225235:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22246
00000001:00000040:20.0:1550079902.225236:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 197
00000100:00000040:1.0:1550079902.225576:0:20243:0:(events.c:348:request_in_callback()) incoming req@ffff9cb3e8d98000 x1625285162576624 msgsize 592
00000020:00000040:9.0:1550079902.225583:0:20811:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:9.0:1550079902.225585:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40339
00000100:00000040:9.0:1550079902.225589:0:20811:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +743s
00000100:00000040:9.0:1550079902.225593:0:20811:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:9.0:1550079902.225596:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb3e8d98000 x1625285162576624/t0(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:720/0 lens 592/0 e 0 to 0 dl 1550080650 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:9.0:1550079902.225603:0:20811:0:(ldlm_lockd.c:1194:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000040:9.0:1550079902.225606:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 2
00000020:00000040:9.0:1550079902.225610:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb479348fc0 with handle 0x6bcd99f6a9ded740 to hash
00010000:00000040:9.0:1550079902.225611:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:9.0:1550079902.225612:0:20811:0:(ldlm_lockd.c:1262:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb479348fc0/0x6bcd99f6a9ded740 lrc: 2/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 nid: local remote: 0xe4402ff315162f63 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225616:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:9.0:1550079902.225617:0:20811:0:(ldlm_lockd.c:1289:ldlm_handle_enqueue0()) lock GETting export ffff9ca482e32c00 : new locks_count 40311
00000020:00000040:9.0:1550079902.225618:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40340
00000004:00000040:9.0:1550079902.225621:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x200001855:0x703:0x0]
00010000:00000040:9.0:1550079902.225627:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00000020:00000040:9.0:1550079902.225629:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb47934a880 with handle 0x6bcd99f6a9ded747 to hash
00010000:00000040:9.0:1550079902.225630:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225631:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 3/1,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225634:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225636:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x200001855:0x703:0x0].0x0 (ffff9cc4fb698780) refcount = 3
00010000:00000040:9.0:1550079902.225637:0:20811:0:(ldlm_resource.c:1728:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:9.0:1550079902.225638:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00000040:9.0:1550079902.225639:0:20811:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9ca479b4b840/0x6bcd99f5afa61a37 lrc: 2/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff314a69bff expref: 40340 pid: 21330 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225643:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225643:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225644:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 3/1,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225647:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225649:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225650:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 3/1,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225657:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00000020:00000040:9.0:1550079902.225659:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb47934e780 with handle 0x6bcd99f6a9ded74e to hash
00010000:00000040:9.0:1550079902.225660:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225661:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 3/1,0 mode: --/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225664:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225665:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x200001855:0x703:0x0].0x3777416f (ffff9cb4e5715980) refcount = 1
00010000:00000040:9.0:1550079902.225666:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225667:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 3/1,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225670:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225671:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225671:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 3/1,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225674:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00000004:00000040:9.0:1550079902.225691:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x1178:0x0]
00000020:00000040:9.0:1550079902.225695:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb47934b3c0 with handle 0x6bcd99f6a9ded755 to hash
00010000:00000040:9.0:1550079902.225696:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00010000:00010000:9.0:1550079902.225697:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934b3c0/0x6bcd99f6a9ded755 lrc: 3/1,0 mode: --/PR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225700:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 1
00010000:00000040:9.0:1550079902.225701:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x2000036f0:0x1178:0x0].0x0 (ffff9cb4e57143c0) refcount = 1
00010000:00000040:9.0:1550079902.225702:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00010000:00010000:9.0:1550079902.225702:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934b3c0/0x6bcd99f6a9ded755 lrc: 3/1,0 mode: PR/PR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225709:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 1
00010000:00000040:9.0:1550079902.225710:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00010000:00010000:9.0:1550079902.225711:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934b3c0/0x6bcd99f6a9ded755 lrc: 3/1,0 mode: PR/PR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225714:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 1
00000004:00000040:9.0:1550079902.225721:0:20811:0:(mdt_lib.c:655:mdt_dump_lmm()) objid 0x0:8, magic 0x0BD60BD0, pattern 0X290
00010000:00000040:9.0:1550079902.225724:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00000004:00010000:9.0:1550079902.225725:0:20811:0:(mdt_handler.c:1856:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934b3c0/0x6bcd99f6a9ded755 lrc: 3/1,0 mode: PR/PR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225728:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 1
00010000:00000040:9.0:1550079902.225730:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00000004:00000040:9.0:1550079902.225731:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x1178:0x0]
00000004:00010000:9.0:1550079902.225732:0:20811:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x1178:0x0] updating lvb size from disk: 0 -> 131072
00000004:00010000:9.0:1550079902.225734:0:20811:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x1178:0x0] updating lvb mtime from disk: 0 -> 1549926807
00000004:00010000:9.0:1550079902.225735:0:20811:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x1178:0x0] updating lvb atime from disk: 0 -> 1550070014
00000004:00010000:9.0:1550079902.225736:0:20811:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x1178:0x0] updating lvb ctime from disk: 0 -> 1549926807
00000004:00010000:9.0:1550079902.225737:0:20811:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x2000036f0:0x1178:0x0] updating lvb blocks from disk: 18427282363563114435 -> 256
00002000:00010000:9.0:1550079902.225738:0:20811:0:(mdt_io.c:1004:mdt_lvb2body()) size 131072
00010000:00000040:9.0:1550079902.225739:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 1
00010000:00000040:9.0:1550079902.225740:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225740:0:20811:0:(ldlm_lock.c:807:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 3/1,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225744:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225744:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225745:0:20811:0:(ldlm_lock.c:863:ldlm_lock_decref_internal()) ### final decref done on cbpending lock ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 2/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225752:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225753:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225753:0:20811:0:(ldlm_lockd.c:1727:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 3/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225756:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00010000:9.0:1550079902.225757:0:20811:0:(ldlm_lockd.c:1758:ldlm_handle_bl_callback()) Lock ffff9cb47934a880 already unused, calling callback (ffffffffc18d67d0)
00010000:00000040:9.0:1550079902.225758:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225758:0:20811:0:(ldlm_request.c:347:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 3/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225761:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225762:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225763:0:20811:0:(ldlm_request.c:1278:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 4/0,0 mode: CR/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225766:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00000020:00000040:9.0:1550079902.225767:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb47934a880 with handle 0x6bcd99f6a9ded747 from hash
00010000:00000040:9.0:1550079902.225768:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225769:0:20811:0:(ldlm_lockd.c:1767:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 2/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225772:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225773:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 4
00010000:00010000:9.0:1550079902.225773:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934a880/0x6bcd99f6a9ded747 lrc: 0/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225776:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 3
00010000:00000040:9.0:1550079902.225777:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:9.0:1550079902.225778:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225779:0:20811:0:(ldlm_lock.c:807:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 3/1,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225782:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225783:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225783:0:20811:0:(ldlm_lock.c:863:ldlm_lock_decref_internal()) ### final decref done on cbpending lock ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 2/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225786:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225787:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225787:0:20811:0:(ldlm_lockd.c:1727:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 3/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225790:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00010000:9.0:1550079902.225791:0:20811:0:(ldlm_lockd.c:1758:ldlm_handle_bl_callback()) Lock ffff9cb47934e780 already unused, calling callback (ffffffffc18d67d0)
00010000:00000040:9.0:1550079902.225792:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225792:0:20811:0:(ldlm_request.c:347:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 3/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225795:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225796:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225797:0:20811:0:(ldlm_request.c:1278:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 4/0,0 mode: PR/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225800:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00000020:00000040:9.0:1550079902.225800:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb47934e780 with handle 0x6bcd99f6a9ded74e from hash
00010000:00000040:9.0:1550079902.225801:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225802:0:20811:0:(ldlm_lockd.c:1767:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 2/0,0 mode: --/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225805:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225806:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e5715980 count: 2
00010000:00010000:9.0:1550079902.225807:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934e780/0x6bcd99f6a9ded74e lrc: 0/0,0 mode: --/PR res: [0x200001855:0x703:0x0].0x3777416f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225810:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 1
00010000:00000040:9.0:1550079902.225810:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e5715980 count: 0
00000004:00000040:9.0:1550079902.225812:0:20811:0:(mdt_handler.c:3550:mdt_intent_lock_replace()) lock GETting export ffff9ca482e32c00 : new locks_count 40312
00000020:00000040:9.0:1550079902.225812:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40341
00000004:00000040:9.0:1550079902.225814:0:20811:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 656 cookie/acl_size = 0
00000020:00000040:9.0:1550079902.225816:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb479348fc0 with handle 0x6bcd99f6a9ded740 from hash
00010000:00000040:9.0:1550079902.225817:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:9.0:1550079902.225818:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9cb479348fc0/0x6bcd99f6a9ded740 lrc: 0/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44000000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f63 expref: 40341 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225822:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:9.0:1550079902.225822:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 1
00010000:00000040:9.0:1550079902.225823:0:20811:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca482e32c00 : new locks_count 40311
00000020:00000040:9.0:1550079902.225824:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40340
00010000:00000040:9.0:1550079902.225825:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00010000:00010000:9.0:1550079902.225827:0:20811:0:(ldlm_lockd.c:1410:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply(err=0, rc=0) ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934b3c0/0x6bcd99f6a9ded755 lrc: 3/0,0 mode: PR/PR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f63 expref: 40340 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.225830:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 1
00010000:00010000:9.0:1550079902.225831:0:20811:0:(ldlm_lockd.c:1488:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff9cb47934b3c0, rc 0)
00010000:00000040:9.0:1550079902.225832:0:20811:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 0, xid 1625285162576624
00000100:00000040:9.0:1550079902.225835:0:20811:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:9.0:1550079902.225837:0:20811:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:9.0:1550079902.225846:0:20811:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:9.0:1550079902.225848:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb3e8d98000 x1625285162576624/t0(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:720/0 lens 592/1192 e 0 to 0 dl 1550080650 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:9.0:1550079902.225855:0:20811:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:9.0:1550079902.225857:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40339
00010000:00000040:5.0:1550079902.225946:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265375
00000004:00000040:5.0:1550079902.225947:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.225948:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265376
00010000:00010000:5.0:1550079902.225950:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a228e780/0x6bcd99f6a80a51f8 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265376 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0fb60d expref: 265384 pid: 21799 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.225953:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265375
00000020:00000040:5.0:1550079902.225955:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd4a228e780 with handle 0x6bcd99f6a80a51f8 from hash
00010000:00000040:5.0:1550079902.225956:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265374
00010000:00000040:5.0:1550079902.225957:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265375
00010000:00010000:5.0:1550079902.225958:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd4a228e780/0x6bcd99f6a80a51f8 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265375 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff0fb60d expref: 265384 pid: 21799 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.225961:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265374
00010000:00000040:5.0:1550079902.225961:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265373
00010000:00000040:5.0:1550079902.225962:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265381
00000020:00000040:5.0:1550079902.225963:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265383
00000001:00000040:5.0:1550079902.225964:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 252
00010000:00000040:20.0:1550079902.226201:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22246
00000004:00000040:20.0:1550079902.226202:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.226203:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb414fb6e40 with handle 0x6bcd99f6a83277a3 from hash
00010000:00000040:20.0:1550079902.226205:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22245
00010000:00000040:20.0:1550079902.226206:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22246
00010000:00010000:20.0:1550079902.226207:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb414fb6e40/0x6bcd99f6a83277a3 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22246 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c96fbe expref: 22246 pid: 21450 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.226214:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22245
00010000:00000040:20.0:1550079902.226215:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22244
00010000:00000040:20.0:1550079902.226215:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22244
00000020:00000040:20.0:1550079902.226216:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22245
00000001:00000040:20.0:1550079902.226217:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 198
00000100:00000040:22.0:1550079902.226697:0:20246:0:(events.c:348:request_in_callback()) incoming req@ffff9cb2d6a00450 x1624736420237712 msgsize 224
00000100:00000040:22.0:1550079902.226699:0:20246:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:11.0:1550079902.226708:0:38445:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f60a2bcb4c
00000020:00000040:11.0:1550079902.226710:0:38445:0:(genops.c:1008:class_export_get()) GETting export ffff9cc3f67a4400 : new refcount 13
00000100:00000040:11.0:1550079902.226713:0:38445:0:(service.c:1210:ptlrpc_at_set_timer()) armed mgs at +38s
00010000:00000040:5.0:1550079902.226716:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265374
00000004:00000040:5.0:1550079902.226717:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00000100:00000040:11.0:1550079902.226718:0:38445:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9cc3f67a4400 : new rpc_count 1
00010000:00000040:5.0:1550079902.226718:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265375
00000100:00000040:11.0:1550079902.226720:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb2d6a00450 x1624736420237712/t0(0) o400->685d6636-c24c-520f-b52c-b6206c8e8383@10.8.10.25@o2ib6:15/0 lens 224/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:5.0:1550079902.226720:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9d818e0b40/0x6bcd99f6a7eedab7 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265375 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff08b60d expref: 265383 pid: 21336 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.226724:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265374
00000020:00000040:5.0:1550079902.226725:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9d818e0b40 with handle 0x6bcd99f6a7eedab7 from hash
00010000:00000040:11.0:1550079902.226726:0:38445:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 0, transno 0, xid 1624736420237712
00010000:00000040:5.0:1550079902.226726:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265373
00010000:00000040:5.0:1550079902.226727:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265374
00000100:00000040:11.0:1550079902.226728:0:38445:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cc4f638a2a0 refcount 6 to 10.8.10.25@o2ib6
00000100:00000040:11.0:1550079902.226730:0:38445:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.10.25@o2ib6
00010000:00010000:5.0:1550079902.226733:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9d818e0b40/0x6bcd99f6a7eedab7 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265374 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff08b60d expref: 265383 pid: 21336 timeout: 62419 lvb_type: 0
00010000:00000040:5.0:1550079902.226736:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265373
00010000:00000040:5.0:1550079902.226736:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265372
00010000:00000040:5.0:1550079902.226737:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265380
00000020:00000040:5.0:1550079902.226738:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265382
00000001:00000040:5.0:1550079902.226739:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 253
00000100:00000040:11.0:1550079902.226742:0:38445:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cc4f638a2a0 refcount 5 to 10.8.10.25@o2ib6
00000100:00000040:11.0:1550079902.226744:0:38445:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb2d6a00450 x1624736420237712/t0(0) o400->685d6636-c24c-520f-b52c-b6206c8e8383@10.8.10.25@o2ib6:15/0 lens 224/192 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:11.0:1550079902.226748:0:38445:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9cc3f67a4400 : new rpc_count 0
00000020:00000040:11.0:1550079902.226750:0:38445:0:(genops.c:1018:class_export_put()) PUTting export ffff9cc3f67a4400 : new refcount 12
00010000:00000040:20.0:1550079902.227183:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22245
00000004:00000040:20.0:1550079902.227184:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.227185:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4427198c0 with handle 0x6bcd99f6a803615d from hash
00010000:00000040:20.0:1550079902.227187:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22244
00010000:00000040:20.0:1550079902.227188:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22245
00010000:00010000:20.0:1550079902.227189:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4427198c0/0x6bcd99f6a803615d lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22245 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52c26fbe expref: 22245 pid: 20822 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.227192:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22244
00010000:00000040:20.0:1550079902.227193:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22243
00010000:00000040:20.0:1550079902.227194:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22243
00000020:00000040:20.0:1550079902.227195:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22244
00000001:00000040:20.0:1550079902.227196:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 199
00000100:00000040:41.0:1550079902.227257:0:20240:0:(events.c:348:request_in_callback()) incoming req@ffff9cb43e7f8c00 x1625285162576688 msgsize 1768
00000020:00000040:9.0:1550079902.227263:0:20811:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:9.0:1550079902.227264:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40340
00000100:00000040:9.0:1550079902.227267:0:20811:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +21s
00000100:00000040:9.0:1550079902.227271:0:20811:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:9.0:1550079902.227273:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cb43e7f8c00 x1625285162576688/t0(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:753/0 lens 1768/0 e 0 to 0 dl 1550079928 ref 1 fl New:/0/ffffffff rc 0/-1
00010000:00010000:9.0:1550079902.227278:0:20811:0:(ldlm_lockd.c:1194:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000040:9.0:1550079902.227281:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 2
00000020:00000040:9.0:1550079902.227283:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9ca0cc177500 with handle 0x6bcd99f6a9ded75c to hash
00010000:00000040:9.0:1550079902.227284:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:9.0:1550079902.227285:0:20811:0:(ldlm_lockd.c:1262:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9ca0cc177500/0x6bcd99f6a9ded75c lrc: 2/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 nid: local remote: 0xe4402ff315162f7f expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227288:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:9.0:1550079902.227289:0:20811:0:(ldlm_lockd.c:1289:ldlm_handle_enqueue0()) lock GETting export ffff9ca482e32c00 : new locks_count 40312
00000020:00000040:9.0:1550079902.227289:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40341
00000004:00000040:9.0:1550079902.227296:0:20811:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x1178:0x0]
00010000:00000040:9.0:1550079902.227301:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 2
00000020:00000040:9.0:1550079902.227302:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9ca0cc174380 with handle 0x6bcd99f6a9ded763 to hash
00010000:00000040:9.0:1550079902.227303:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 3
00010000:00010000:9.0:1550079902.227303:0:20811:0:(ldlm_lock.c:753:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-fir-MDT0000_UUID lock: ffff9ca0cc174380/0x6bcd99f6a9ded763 lrc: 3/1,0 mode: --/CR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227307:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 2
00010000:00000040:9.0:1550079902.227308:0:20811:0:(ldlm_resource.c:1725:ldlm_resource_dump()) --- Resource: [0x2000036f0:0x1178:0x0].0x0 (ffff9cb4e57143c0) refcount = 2
00010000:00000040:9.0:1550079902.227309:0:20811:0:(ldlm_resource.c:1728:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:9.0:1550079902.227310:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 3
00010000:00000040:9.0:1550079902.227311:0:20811:0:(ldlm_resource.c:1731:ldlm_resource_dump()) ### ### ns: mdt-fir-MDT0000_UUID lock: ffff9cb47934b3c0/0x6bcd99f6a9ded755 lrc: 2/0,0 mode: PR/PR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f63 expref: 40341 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227317:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 2
00010000:00000040:9.0:1550079902.227318:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 3
00010000:00010000:9.0:1550079902.227319:0:20811:0:(ldlm_lock.c:1054:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-fir-MDT0000_UUID lock: ffff9ca0cc174380/0x6bcd99f6a9ded763 lrc: 3/1,0 mode: CR/CR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227322:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 2
00010000:00000040:9.0:1550079902.227323:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 3
00010000:00010000:9.0:1550079902.227323:0:20811:0:(ldlm_request.c:503:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-fir-MDT0000_UUID lock: ffff9ca0cc174380/0x6bcd99f6a9ded763 lrc: 3/1,0 mode: CR/CR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227327:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 2
00000020:00000040:9.0:1550079902.227330:0:20811:0:(lustre_handles.c:99:class_handle_hash()) added object ffff9cb3e4fcf880 with handle 0x6bcd99f6a9ded76a to hash
00000001:00000040:9.0:1550079902.227335:0:20811:0:(tgt_lastrcvd.c:921:tgt_last_commit_cb_add()) callback GETting export ffff9ca482e32c00 : new cb_count 24
00000020:00000040:9.0:1550079902.227336:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40342
00000004:00000040:9.0:1550079902.227342:0:20811:0:(mdt_lib.c:736:mdt_fix_reply()) Shrink to md_size = 656 cookie/acl_size = 0
00000004:00000040:9.0:1550079902.227343:0:20811:0:(mdt_handler.c:3550:mdt_intent_lock_replace()) lock GETting export ffff9ca482e32c00 : new locks_count 40313
00000020:00000040:9.0:1550079902.227344:0:20811:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40343
00000020:00000040:9.0:1550079902.227346:0:20811:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca0cc177500 with handle 0x6bcd99f6a9ded75c from hash
00010000:00000040:9.0:1550079902.227347:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc4fb698780 count: 3
00010000:00010000:9.0:1550079902.227348:0:20811:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0000_UUID lock: ffff9ca0cc177500/0x6bcd99f6a9ded75c lrc: 0/0,0 mode: --/CR res: [0x200001855:0x703:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44000000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f7f expref: 40343 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227351:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 2
00010000:00000040:9.0:1550079902.227352:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc4fb698780 count: 1
00010000:00000040:9.0:1550079902.227352:0:20811:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca482e32c00 : new locks_count 40312
00000020:00000040:9.0:1550079902.227353:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40342
00010000:00000040:9.0:1550079902.227354:0:20811:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 3
00010000:00010000:9.0:1550079902.227356:0:20811:0:(ldlm_lockd.c:1410:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply(err=0, rc=0) ns: mdt-fir-MDT0000_UUID lock: ffff9ca0cc174380/0x6bcd99f6a9ded763 lrc: 3/0,0 mode: CR/CR res: [0x2000036f0:0x1178:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40200000000000 nid: 10.8.17.29@o2ib6 remote: 0xe4402ff315162f7f expref: 40342 pid: 20811 timeout: 0 lvb_type: 0
00010000:00000040:9.0:1550079902.227363:0:20811:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 2
00010000:00010000:9.0:1550079902.227364:0:20811:0:(ldlm_lockd.c:1488:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff9ca0cc174380, rc 0)
00010000:00000040:9.0:1550079902.227364:0:20811:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 38754597601, xid 1625285162576688
00000100:00000040:9.0:1550079902.227367:0:20811:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:9.0:1550079902.227369:0:20811:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:9.0:1550079902.227376:0:20811:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:32.0:1550079902.227378:0:20238:0:(events.c:348:request_in_callback()) incoming req@ffff9ca098dfa100 x1624736420237728 msgsize 224
00000100:00000040:9.0:1550079902.227378:0:20811:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cb43e7f8c00 x1625285162576688/t38754597601(0) o101->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:753/0 lens 1768/1216 e 0 to 0 dl 1550079928 ref 1 fl Interpret:/0/0 rc 0/0
00000100:00000040:9.0:1550079902.227385:0:20811:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:36.0:1550079902.227386:0:21809:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa1485b
00000020:00000040:9.0:1550079902.227386:0:20811:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40341
00000020:00000040:36.0:1550079902.227388:0:21809:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482f5d400 : new refcount 28
00000100:00000040:36.0:1550079902.227391:0:21809:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt at +743s
00000100:00000040:36.0:1550079902.227396:0:21809:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482f5d400 : new rpc_count 1
00000100:00000040:36.0:1550079902.227398:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9ca098dfa100 x1624736420237728/t0(0) o400->8d2770a4-8644-bfcc-28b0-b27c81e7a951@10.8.10.25@o2ib6:720/0 lens 224/0 e 0 to 0 dl 1550080650 ref 1 fl New:H/0/ffffffff rc 0/-1
00010000:00000040:36.0:1550079902.227403:0:21809:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754293610, transno 0, xid 1624736420237728
00000100:00000040:36.0:1550079902.227405:0:21809:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cc4f638a2a0 refcount 6 to 10.8.10.25@o2ib6
00000100:00000040:36.0:1550079902.227407:0:21809:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.10.25@o2ib6
00000100:00000040:36.0:1550079902.227417:0:21809:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cc4f638a2a0 refcount 5 to 10.8.10.25@o2ib6
00000100:00000040:36.0:1550079902.227419:0:21809:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9ca098dfa100 x1624736420237728/t0(0) o400->8d2770a4-8644-bfcc-28b0-b27c81e7a951@10.8.10.25@o2ib6:720/0 lens 224/192 e 0 to 0 dl 1550080650 ref 1 fl Interpret:H/0/0 rc 0/0
00000100:00000040:36.0:1550079902.227423:0:21809:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482f5d400 : new rpc_count 0
00000020:00000040:36.0:1550079902.227424:0:21809:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482f5d400 : new refcount 27
00010000:00000040:5.0:1550079902.227496:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265373
00000004:00000040:5.0:1550079902.227497:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.227498:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265374
00010000:00010000:5.0:1550079902.227500:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb46b9706c0/0x6bcd99f6a7c16e91 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265374 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff01b60d expref: 265382 pid: 21448 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.227503:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265373
00000020:00000040:5.0:1550079902.227505:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb46b9706c0 with handle 0x6bcd99f6a7c16e91 from hash
00010000:00000040:5.0:1550079902.227506:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265372
00010000:00000040:5.0:1550079902.227507:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265373
00010000:00010000:5.0:1550079902.227508:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb46b9706c0/0x6bcd99f6a7c16e91 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265373 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff01b60d expref: 265382 pid: 21448 timeout: 62420 lvb_type: 0
00010000:00000040:5.0:1550079902.227511:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265372
00010000:00000040:5.0:1550079902.227511:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265371
00010000:00000040:5.0:1550079902.227512:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265379
00000020:00000040:5.0:1550079902.227513:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265381
00000001:00000040:5.0:1550079902.227514:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 254
00010000:00000040:20.0:1550079902.228162:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22244
00000004:00000040:20.0:1550079902.228163:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.228164:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e3969aac0 with handle 0x6bcd99f6a7b2d41a from hash
00010000:00000040:20.0:1550079902.228166:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22243
00010000:00000040:20.0:1550079902.228167:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22244
00010000:00010000:20.0:1550079902.228168:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e3969aac0/0x6bcd99f6a7b2d41a lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22244 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52bb6fbe expref: 22244 pid: 21794 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.228171:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22243
00010000:00000040:20.0:1550079902.228172:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22242
00010000:00000040:20.0:1550079902.228173:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22242
00000020:00000040:20.0:1550079902.228174:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22243
00000001:00000040:20.0:1550079902.228175:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 200
00010000:00000040:5.0:1550079902.228272:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265372
00000004:00000040:5.0:1550079902.228273:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.228273:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265373
00010000:00010000:5.0:1550079902.228275:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb4476ce300/0x6bcd99f6a790e9e3 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265373 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefab60d expref: 265381 pid: 21884 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.228279:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265372
00000020:00000040:5.0:1550079902.228281:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb4476ce300 with handle 0x6bcd99f6a790e9e3 from hash
00010000:00000040:5.0:1550079902.228282:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265371
00010000:00000040:5.0:1550079902.228282:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265372
00010000:00010000:5.0:1550079902.228284:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb4476ce300/0x6bcd99f6a790e9e3 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265372 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fefab60d expref: 265381 pid: 21884 timeout: 62421 lvb_type: 0
00010000:00000040:5.0:1550079902.228287:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265371
00010000:00000040:5.0:1550079902.228287:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265370
00010000:00000040:5.0:1550079902.228288:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265378
00000020:00000040:5.0:1550079902.228289:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265380
00000001:00000040:5.0:1550079902.228290:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 255
00010000:00000040:5.0:1550079902.229046:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265371
00000004:00000040:5.0:1550079902.229046:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.229047:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265372
00010000:00010000:5.0:1550079902.229048:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd469f74380/0x6bcd99f6a76a1079 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265372 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef3b60d expref: 265380 pid: 21343 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.229052:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265371
00000020:00000040:5.0:1550079902.229053:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd469f74380 with handle 0x6bcd99f6a76a1079 from hash
00010000:00000040:5.0:1550079902.229054:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265370
00010000:00000040:5.0:1550079902.229055:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265371
00010000:00010000:5.0:1550079902.229056:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd469f74380/0x6bcd99f6a76a1079 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265371 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fef3b60d expref: 265380 pid: 21343 timeout: 62422 lvb_type: 0
00010000:00000040:5.0:1550079902.229059:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265370
00010000:00000040:5.0:1550079902.229059:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265369
00010000:00000040:5.0:1550079902.229060:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265377
00000020:00000040:5.0:1550079902.229061:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265379
00000001:00000040:5.0:1550079902.229062:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 256
00010000:00000040:20.0:1550079902.229139:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22243
00000004:00000040:20.0:1550079902.229140:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.229142:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd45794b180 with handle 0x6bcd99f6a78094f9 from hash
00010000:00000040:20.0:1550079902.229143:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22242
00010000:00000040:20.0:1550079902.229144:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22243
00010000:00010000:20.0:1550079902.229145:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd45794b180/0x6bcd99f6a78094f9 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22243 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52b46fbe expref: 22243 pid: 21773 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.229148:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22242
00010000:00000040:20.0:1550079902.229149:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22241
00010000:00000040:20.0:1550079902.229150:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22241
00000020:00000040:20.0:1550079902.229151:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22242
00000001:00000040:20.0:1550079902.229152:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 201
00000100:00000040:22.0:1550079902.229568:0:20244:0:(events.c:348:request_in_callback()) incoming req@ffff9cc3f8439850 x1625285162576720 msgsize 488
00000100:00000040:22.0:1550079902.229569:0:20244:0:(events.c:360:request_in_callback()) Buffer complete: 63 buffers still posted
00000020:00000040:14.0:1550079902.229576:0:21651:0:(genops.c:941:class_conn2export()) looking for export cookie 0x6bcd99f5afa143b5
00000020:00000040:14.0:1550079902.229578:0:21651:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40342
00000100:00000040:14.0:1550079902.229582:0:21651:0:(service.c:1210:ptlrpc_at_set_timer()) armed mdt_io at +38s
00000100:00000040:14.0:1550079902.229588:0:21651:0:(service.c:1890:ptlrpc_server_request_get()) RPC GETting export ffff9ca482e32c00 : new rpc_count 1
00000100:00000040:14.0:1550079902.229591:0:21651:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "New" -> "Interpret"  req@ffff9cc3f8439850 x1625285162576720/t0(0) o3->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:15/0 lens 488/0 e 0 to 0 dl 1550079945 ref 1 fl New:/0/ffffffff rc 0/-1
00000004:00000040:14.0:1550079902.229600:0:21651:0:(mdt_handler.c:2580:mdt_object_find()) Find object for [0x2000036f0:0x1178:0x0]
00010000:00000040:5.0:1550079902.229810:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265370
00000004:00000040:5.0:1550079902.229811:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.229812:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265371
00010000:00010000:5.0:1550079902.229813:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb433739200/0x6bcd99f6a7461e89 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265371 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feecb60d expref: 265379 pid: 21767 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.229817:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265370
00000020:00000040:5.0:1550079902.229818:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb433739200 with handle 0x6bcd99f6a7461e89 from hash
00010000:00000040:5.0:1550079902.229819:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265369
00010000:00000040:5.0:1550079902.229821:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265370
00010000:00010000:5.0:1550079902.229822:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb433739200/0x6bcd99f6a7461e89 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265370 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10feecb60d expref: 265379 pid: 21767 timeout: 62423 lvb_type: 0
00010000:00000040:5.0:1550079902.229825:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265369
00010000:00000040:5.0:1550079902.229826:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265368
00010000:00000040:5.0:1550079902.229826:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265376
00000020:00000040:5.0:1550079902.229827:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265378
00000001:00000040:5.0:1550079902.229828:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 257
00010000:00000040:20.0:1550079902.230116:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22242
00000004:00000040:20.0:1550079902.230117:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.230119:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd48c3d7bc0 with handle 0x6bcd99f6a75400de from hash
00010000:00000040:20.0:1550079902.230120:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22241
00010000:00000040:20.0:1550079902.230121:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22242
00010000:00010000:20.0:1550079902.230122:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd48c3d7bc0/0x6bcd99f6a75400de lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22242 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ad6fbe expref: 22242 pid: 21877 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.230125:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22241
00010000:00000040:20.0:1550079902.230126:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22240
00010000:00000040:20.0:1550079902.230127:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22240
00000020:00000040:20.0:1550079902.230127:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22241
00000001:00000040:20.0:1550079902.230128:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 202
00010000:00000040:5.0:1550079902.230585:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265369
00000004:00000040:5.0:1550079902.230585:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.230586:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265370
00010000:00010000:5.0:1550079902.230588:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca2b9c37980/0x6bcd99f6a71b4597 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265370 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee5b60d expref: 265378 pid: 21840 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.230592:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265369
00000020:00000040:5.0:1550079902.230593:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca2b9c37980 with handle 0x6bcd99f6a71b4597 from hash
00010000:00000040:5.0:1550079902.230594:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265368
00010000:00000040:5.0:1550079902.230595:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265369
00010000:00010000:5.0:1550079902.230597:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca2b9c37980/0x6bcd99f6a71b4597 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265369 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fee5b60d expref: 265378 pid: 21840 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.230600:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265368
00010000:00000040:5.0:1550079902.230600:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265367
00010000:00000040:5.0:1550079902.230601:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265375
00000020:00000040:5.0:1550079902.230602:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265377
00000001:00000040:5.0:1550079902.230603:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 258
00000020:00000040:14.0:1550079902.230890:0:21651:0:(genops.c:1008:class_export_get()) GETting export ffff9ca482e32c00 : new refcount 40343
00000001:00000040:14.0:1550079902.230895:0:21651:0:(linux-crypto.c:128:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4715 MB/s
00000020:00000040:14.0:1550079902.230896:0:21651:0:(tgt_handler.c:1735:tgt_checksum_niobuf()) Checksum for algo crc32c
00010000:00000040:20.0:1550079902.231101:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22241
00000004:00000040:20.0:1550079902.231102:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.231104:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e84897980 with handle 0x6bcd99f6a72221ef from hash
00010000:00000040:20.0:1550079902.231105:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22240
00010000:00000040:20.0:1550079902.231106:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22241
00010000:00010000:20.0:1550079902.231108:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e84897980/0x6bcd99f6a72221ef lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22241 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52a66fbe expref: 22241 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.231111:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22240
00010000:00000040:20.0:1550079902.231112:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22239
00010000:00000040:20.0:1550079902.231113:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22239
00000020:00000040:20.0:1550079902.231113:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22240
00000001:00000040:20.0:1550079902.231114:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 203
00010000:00000040:5.0:1550079902.231359:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265368
00000004:00000040:5.0:1550079902.231360:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.231361:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265369
00010000:00010000:5.0:1550079902.231362:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9ca3df5b8d80/0x6bcd99f6a6f9fb8e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265369 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedeb60d expref: 265377 pid: 20616 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.231366:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265368
00000020:00000040:5.0:1550079902.231367:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9ca3df5b8d80 with handle 0x6bcd99f6a6f9fb8e from hash
00010000:00000040:5.0:1550079902.231368:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265367
00010000:00000040:5.0:1550079902.231369:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265368
00010000:00010000:5.0:1550079902.231370:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9ca3df5b8d80/0x6bcd99f6a6f9fb8e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265368 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fedeb60d expref: 265377 pid: 20616 timeout: 62424 lvb_type: 0
00010000:00000040:5.0:1550079902.231374:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265367
00010000:00000040:5.0:1550079902.231374:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265366
00010000:00000040:5.0:1550079902.231375:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265374
00000020:00000040:5.0:1550079902.231376:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265376
00000001:00000040:5.0:1550079902.231377:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 259
00010000:00000040:14.0:1550079902.231426:0:21651:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cb4e57143c0 count: 3
00010000:00000040:14.0:1550079902.231428:0:21651:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cb4e57143c0 count: 2
00000020:00000040:14.0:1550079902.231433:0:21651:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40342
00010000:00000040:14.0:1550079902.231435:0:21651:0:(ldlm_lib.c:2894:target_committed_to_req()) last_committed 38754597449, transno 0, xid 1625285162576720
00000100:00000040:14.0:1550079902.231439:0:21651:0:(connection.c:132:ptlrpc_connection_addref()) conn=ffff9cb4f969c1e0 refcount 6 to 10.8.17.29@o2ib6
00000100:00000040:14.0:1550079902.231441:0:21651:0:(niobuf.c:57:ptl_send_buf()) peer_id 12345-10.8.17.29@o2ib6
00000100:00000040:14.0:1550079902.231447:0:21651:0:(connection.c:119:ptlrpc_connection_put()) PUT conn=ffff9cb4f969c1e0 refcount 5 to 10.8.17.29@o2ib6
00000100:00000040:14.0:1550079902.231449:0:21651:0:(lustre_net.h:2483:ptlrpc_rqphase_move()) @@@ move req "Interpret" -> "Complete"  req@ffff9cc3f8439850 x1625285162576720/t0(0) o3->c3ee8e29-24b2-60ad-b950-c5ea318742ba@10.8.17.29@o2ib6:15/0 lens 488/408 e 0 to 0 dl 1550079945 ref 1 fl Interpret:/0/0 rc 131072/131072
00000100:00000040:14.0:1550079902.231454:0:21651:0:(service.c:1057:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9ca482e32c00 : new rpc_count 0
00000020:00000040:14.0:1550079902.231457:0:21651:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca482e32c00 : new refcount 40341
00010000:00000040:20.0:1550079902.232080:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22240
00000004:00000040:20.0:1550079902.232081:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.232083:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3e1ed6780 with handle 0x6bcd99f6a97a1749 from hash
00010000:00000040:20.0:1550079902.232084:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22239
00010000:00000040:20.0:1550079902.232085:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22240
00010000:00010000:20.0:1550079902.232086:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3e1ed6780/0x6bcd99f6a97a1749 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22240 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ea77be expref: 22240 pid: 21448 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.232090:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22239
00010000:00000040:20.0:1550079902.232090:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22238
00010000:00000040:20.0:1550079902.232091:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22238
00000020:00000040:20.0:1550079902.232092:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22239
00000001:00000040:20.0:1550079902.232093:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 204
00010000:00000040:5.0:1550079902.232133:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265367
00000004:00000040:5.0:1550079902.232134:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.232135:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265368
00010000:00010000:5.0:1550079902.232137:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9e21a25e80/0x6bcd99f6a6cec947 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265368 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed7b60d expref: 265376 pid: 21343 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.232141:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265367
00000020:00000040:5.0:1550079902.232142:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9e21a25e80 with handle 0x6bcd99f6a6cec947 from hash
00010000:00000040:5.0:1550079902.232143:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265366
00010000:00000040:5.0:1550079902.232144:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265367
00010000:00010000:5.0:1550079902.232145:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9e21a25e80/0x6bcd99f6a6cec947 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265367 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed7b60d expref: 265376 pid: 21343 timeout: 62425 lvb_type: 0
00010000:00000040:5.0:1550079902.232148:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265366
00010000:00000040:5.0:1550079902.232149:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265365
00010000:00000040:5.0:1550079902.232150:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265373
00000020:00000040:5.0:1550079902.232151:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265375
00000001:00000040:5.0:1550079902.232152:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 260
00010000:00000040:5.0:1550079902.232908:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265366
00000004:00000040:5.0:1550079902.232909:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.232910:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265367
00010000:00010000:5.0:1550079902.232911:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9c9df192c800/0x6bcd99f6a6acef55 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265367 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed0b60d expref: 265375 pid: 21296 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.232914:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265366
00000020:00000040:5.0:1550079902.232915:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9df192c800 with handle 0x6bcd99f6a6acef55 from hash
00010000:00000040:5.0:1550079902.232917:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265365
00010000:00000040:5.0:1550079902.232917:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265366
00010000:00010000:5.0:1550079902.232919:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9df192c800/0x6bcd99f6a6acef55 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265366 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10fed0b60d expref: 265375 pid: 21296 timeout: 62426 lvb_type: 0
00010000:00000040:5.0:1550079902.232922:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265365
00010000:00000040:5.0:1550079902.232922:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265364
00010000:00000040:5.0:1550079902.232923:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265372
00000020:00000040:5.0:1550079902.232924:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265374
00000001:00000040:5.0:1550079902.232925:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 261
00010000:00000040:20.0:1550079902.233057:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22239
00000004:00000040:20.0:1550079902.233058:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.233060:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb431cb6780 with handle 0x6bcd99f6a92672b9 from hash
00010000:00000040:20.0:1550079902.233062:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22238
00010000:00000040:20.0:1550079902.233063:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22239
00010000:00010000:20.0:1550079902.233065:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb431cb6780/0x6bcd99f6a92672b9 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22239 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52e377be expref: 22239 pid: 21324 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.233068:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22238
00010000:00000040:20.0:1550079902.233069:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22237
00010000:00000040:20.0:1550079902.233069:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22237
00000020:00000040:20.0:1550079902.233070:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22238
00000001:00000040:20.0:1550079902.233071:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 205
00010000:00000040:5.0:1550079902.233673:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265365
00000004:00000040:5.0:1550079902.233674:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.233675:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265366
00010000:00010000:5.0:1550079902.233676:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb3fb526e40/0x6bcd99f6a882f2da lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265366 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff37be0d expref: 265374 pid: 20820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.233680:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265365
00000020:00000040:5.0:1550079902.233681:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb3fb526e40 with handle 0x6bcd99f6a882f2da from hash
00010000:00000040:5.0:1550079902.233682:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265364
00010000:00000040:5.0:1550079902.233683:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265365
00010000:00010000:5.0:1550079902.233684:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb3fb526e40/0x6bcd99f6a882f2da lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265365 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff37be0d expref: 265374 pid: 20820 timeout: 62414 lvb_type: 0
00010000:00000040:5.0:1550079902.233687:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265364
00010000:00000040:5.0:1550079902.233688:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265363
00010000:00000040:5.0:1550079902.233689:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265371
00000020:00000040:5.0:1550079902.233690:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265373
00000001:00000040:5.0:1550079902.233691:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 262
00010000:00000040:20.0:1550079902.234035:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22238
00000004:00000040:20.0:1550079902.234036:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.234038:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd46bcc06c0 with handle 0x6bcd99f6a8f19aad from hash
00010000:00000040:20.0:1550079902.234040:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22237
00010000:00000040:20.0:1550079902.234040:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22238
00010000:00010000:20.0:1550079902.234042:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd46bcc06c0/0x6bcd99f6a8f19aad lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22238 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52dc77be expref: 22238 pid: 21725 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.234045:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22237
00010000:00000040:20.0:1550079902.234046:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22236
00010000:00000040:20.0:1550079902.234047:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22236
00000020:00000040:20.0:1550079902.234048:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22237
00000001:00000040:20.0:1550079902.234049:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 206
00010000:00000040:5.0:1550079902.234447:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265364
00000004:00000040:5.0:1550079902.234447:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.234448:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265365
00010000:00010000:5.0:1550079902.234450:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cb463e198c0/0x6bcd99f6a869ae0f lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265365 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff30be0d expref: 265373 pid: 21895 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.234453:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265364
00000020:00000040:5.0:1550079902.234454:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cb463e198c0 with handle 0x6bcd99f6a869ae0f from hash
00010000:00000040:5.0:1550079902.234456:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265363
00010000:00000040:5.0:1550079902.234456:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265364
00010000:00010000:5.0:1550079902.234458:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cb463e198c0/0x6bcd99f6a869ae0f lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265364 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff30be0d expref: 265373 pid: 21895 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.234461:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265363
00010000:00000040:5.0:1550079902.234462:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265362
00010000:00000040:5.0:1550079902.234463:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265370
00000020:00000040:5.0:1550079902.234464:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265372
00000001:00000040:5.0:1550079902.234465:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 263
00010000:00000040:20.0:1550079902.235014:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22237
00000004:00000040:20.0:1550079902.235015:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.235016:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc2ab7b3180 with handle 0x6bcd99f6a8a94059 from hash
00010000:00000040:20.0:1550079902.235018:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22236
00010000:00000040:20.0:1550079902.235018:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22237
00010000:00010000:20.0:1550079902.235020:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc2ab7b3180/0x6bcd99f6a8a94059 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22237 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52d577be expref: 22237 pid: 21853 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1550079902.235023:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22236
00010000:00000040:20.0:1550079902.235024:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22235
00010000:00000040:20.0:1550079902.235025:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22235
00000020:00000040:20.0:1550079902.235026:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22236
00000001:00000040:20.0:1550079902.235027:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 207
00010000:00000040:5.0:1550079902.235221:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265363
00000004:00000040:5.0:1550079902.235222:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.235223:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265364
00010000:00010000:5.0:1550079902.235225:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cd40feddc40/0x6bcd99f6a855f556 lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265364 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff29be0d expref: 265372 pid: 21449 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.235228:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265363
00000020:00000040:5.0:1550079902.235229:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cd40feddc40 with handle 0x6bcd99f6a855f556 from hash
00010000:00000040:5.0:1550079902.235230:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265362
00010000:00000040:5.0:1550079902.235231:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265363
00010000:00010000:5.0:1550079902.235232:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cd40feddc40/0x6bcd99f6a855f556 lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265363 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff29be0d expref: 265372 pid: 21449 timeout: 62415 lvb_type: 0
00010000:00000040:5.0:1550079902.235236:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265362
00010000:00000040:5.0:1550079902.235236:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265361
00010000:00000040:5.0:1550079902.235237:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265369
00000020:00000040:5.0:1550079902.235238:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265371
00000001:00000040:5.0:1550079902.235239:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 264
00010000:00000040:20.0:1550079902.235990:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22236
00000004:00000040:20.0:1550079902.235991:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.235993:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f217b5340 with handle 0x6bcd99f6a86b9c45 from hash
00010000:00000040:20.0:1550079902.235994:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22235
00010000:00000040:20.0:1550079902.235995:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22236
00010000:00000040:5.0:1550079902.235995:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265362
00010000:00010000:20.0:1550079902.235997:0:39227:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9c9f217b5340/0x6bcd99f6a86b9c45 lrc: 0/0,0 mode: --/PR res: [0x2c0003bc4:0x70b7:0x0].0x0 bits 0x40/0x0 rrc: 22236 type: IBT flags: 0x44801000000000 nid: 10.9.105.23@o2ib4 remote: 0xd931992c52ce77be expref: 22236 pid: 20612 timeout: 0 lvb_type: 0
00000004:00000040:5.0:1550079902.235997:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00010000:00000040:5.0:1550079902.235997:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265363
00010000:00010000:5.0:1550079902.235999:0:22866:0:(ldlm_lockd.c:531:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-fir-MDT0002_UUID lock: ffff9cc461aaf500/0x6bcd99f6a8406b4e lrc: 4/0,0 mode: PR/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265363 type: IBT flags: 0x50000400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff22be0d expref: 265371 pid: 21758 timeout: 62416 lvb_type: 0
00010000:00000040:20.0:1550079902.236000:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22235
00010000:00000040:20.0:1550079902.236001:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22234
00010000:00000040:20.0:1550079902.236002:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22234
00000020:00000040:20.0:1550079902.236003:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22235
00010000:00000040:5.0:1550079902.236003:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265362
00000001:00000040:20.0:1550079902.236004:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 208
00000020:00000040:5.0:1550079902.236005:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc461aaf500 with handle 0x6bcd99f6a8406b4e from hash
00010000:00000040:5.0:1550079902.236006:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265361
00010000:00000040:5.0:1550079902.236006:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265362
00010000:00010000:5.0:1550079902.236008:0:22866:0:(ldlm_lock.c:197:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-fir-MDT0002_UUID lock: ffff9cc461aaf500/0x6bcd99f6a8406b4e lrc: 0/0,0 mode: --/PR res: [0x2c00016d5:0x9c:0x0].0x0 bits 0x40/0x0 rrc: 265362 type: IBT flags: 0x44801400010020 nid: 10.9.105.71@o2ib4 remote: 0xf3592e10ff22be0d expref: 265371 pid: 21758 timeout: 62416 lvb_type: 0
00010000:00000040:5.0:1550079902.236011:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265361
00010000:00000040:5.0:1550079902.236011:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265360
00010000:00000040:5.0:1550079902.236012:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265368
00000020:00000040:5.0:1550079902.236013:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265370
00000001:00000040:5.0:1550079902.236014:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 265
00010000:00000040:5.0:1550079902.236766:0:22866:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9c9ceeeef8c0 count: 265361
00000004:00000040:5.0:1550079902.236767:0:22866:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is failed, obd is stopping
00000020:00000040:5.0:1550079902.236768:0:22866:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9cc321f86300 with handle 0x6bcd99f6a82d92cd from hash
00010000:00000040:5.0:1550079902.236770:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265360
00010000:00000040:5.0:1550079902.236770:0:22866:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9c9ceeeef8c0 count: 265359
00010000:00000040:5.0:1550079902.236771:0:22866:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47eb79000 : new locks_count 265367
00000020:00000040:5.0:1550079902.236771:0:22866:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47eb79000 : new refcount 265369
00000001:00000040:5.0:1550079902.236772:0:22866:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 82bcfbd3-d6e5-0, loop: 266
00010000:00000040:20.0:1550079902.236970:0:39227:0:(ldlm_resource.c:1534:ldlm_resource_getref()) getref res: ffff9cc414231380 count: 22235
00000004:00000040:20.0:1550079902.236971:0:39227:0:(mdt_lvb.c:164:mdt_dom_lvbo_update()) Skip LVB update, export is disconnected, obd is stopping
00000020:00000040:20.0:1550079902.236972:0:39227:0:(lustre_handles.c:113:class_handle_unhash_nolock()) removing object ffff9c9f548dc5c0 with handle 0x6bcd99f6a820c3a8 from hash
00010000:00000040:20.0:1550079902.236973:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22234
00010000:00000040:20.0:1550079902.236974:0:39227:0:(ldlm_resource.c:1568:ldlm_resource_putref()) putref res: ffff9cc414231380 count: 22233
00010000:00000040:20.0:1550079902.236975:0:39227:0:(ldlm_lock.c:211:ldlm_lock_put()) lock PUTting export ffff9ca47ebbc400 : new locks_count 22233
00000020:00000040:20.0:1550079902.236976:0:39227:0:(genops.c:1018:class_export_put()) PUTting export ffff9ca47ebbc400 : new refcount 22234
00000001:00000040:20.0:1550079902.236977:0:39227:0:(hash.c:1709:cfs_hash_for_each_empty()) Try to empty hash: 283673e9-8136-e, loop: 209
00010000:02000000:30.0:1550079902.262871:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.43@o2ib4 (stopping)
00010000:02000000:9.0:1550079902.267394:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.57@o2ib4 (stopping)
00010000:02000000:30.0:1550079902.322090:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.67@o2ib4 (stopping)
00010000:02000000:30.0:1550079902.323897:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.53@o2ib4 (stopping)
00010000:02000000:30.0:1550079902.519383:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.16@o2ib4 (stopping)
00010000:02000000:38.0:1550079902.520332:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.33@o2ib4 (stopping)
00010000:02000000:38.0:1550079902.563399:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.9.1@o2ib6 (stopping)
00010000:02000000:13.0:1550079902.582859:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.12.15@o2ib6 (stopping)
00010000:02000000:36.0:1550079902.593180:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.115.3@o2ib4 (stopping)
00010000:02000000:27.0:1550079902.692671:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.54@o2ib4 (stopping)
00010000:02000000:27.0:1550079902.699903:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.33@o2ib4 (stopping)
00010000:02000000:27.0:1550079902.740240:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.43@o2ib4 (stopping)
00010000:02000000:27.0:1550079902.744756:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.36@o2ib4 (stopping)
00010000:02000000:36.0:1550079902.890244:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.36@o2ib4 (stopping)
00010000:02000000:17.0:1550079902.995670:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.8@o2ib6 (stopping)
00010000:02000000:36.0:1550079903.044221:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.58@o2ib4 (stopping)
00010000:02000000:36.0:1550079903.069211:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.20.32@o2ib6 (stopping)
00010000:02000000:17.0:1550079903.146550:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.2@o2ib6 (stopping)
00000004:00000080:36.0:1550079903.205144:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000036ff:0x223:0x0] from 18446744073709551615 #0
00000004:00000080:8.0F:1550079903.205760:0:21839:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000036ff:0x204:0x0] from 18446744073709551615 #0
00000004:00000080:8.0:1550079903.206014:0:21839:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x20000372f:0x36:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079903.209994:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000036ff:0x223:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079903.210146:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000036ff:0x1b3:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079903.210278:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000036ff:0x222:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079903.211874:0:21809:0:(mdt_handler.c:6431:mdt_iocontrol()) handling ioctl cmd 0x424066b3
00000004:00000080:36.0:1550079903.211883:0:21809:0:(mdd_device.c:1763:mdd_changelog_clear()) fir-MDD0000: Purge request: id=1, endrec=1475529288
00000040:00080000:36.0:1550079903.211893:0:21809:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x92:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0]
00000004:00000080:36.0:1550079903.211898:0:21809:0:(mdd_device.c:1736:mdd_changelog_clear_cb()) Rewriting changelog user 1 endrec to 1475529288
00000004:00000080:36.0:1550079903.211906:0:21809:0:(mdd_device.c:1801:mdd_changelog_clear()) fir-MDD0000: Purging changelog entries up to 1475529288
00000040:00080000:36.0:1550079903.211938:0:21809:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x6241:0x1:0x0]:0 at index 23276 of catalog [0x5:0xa:0x0]
00010000:02000000:27.0:1550079903.273174:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.12@o2ib4 (stopping)
00010000:02000000:25.0F:1550079903.322988:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.11@o2ib4 (stopping)
00010000:02000000:36.0:1550079903.347667:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.113.9@o2ib4 (stopping)
00010000:02000000:38.0:1550079903.356208:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.18.2@o2ib6 (stopping)
00010000:02000000:27.0:1550079903.357755:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.8@o2ib4 (stopping)
00010000:02000000:38.0:1550079903.395377:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.40@o2ib4 (stopping)
00010000:02000000:25.0:1550079903.399981:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.13@o2ib4 (stopping)
00010000:02000000:38.0:1550079903.433718:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.62@o2ib4 (stopping)
00010000:02000000:25.0:1550079903.517549:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.10@o2ib4 (stopping)
00010000:02000000:25.0:1550079903.535224:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.27.17@o2ib6 (stopping)
00010000:02000000:38.0:1550079903.655078:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.6@o2ib6 (stopping)
00010000:02000000:27.0:1550079903.673084:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.45@o2ib4 (stopping)
00010000:02000000:38.0:1550079903.682581:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.114.7@o2ib4 (stopping)
00010000:02000000:38.0:1550079903.911332:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.114.15@o2ib4 (stopping)
00010000:02000000:38.0:1550079903.929303:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.35@o2ib4 (stopping)
00010000:02000000:27.0:1550079903.941649:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.2@o2ib4 (stopping)
00010000:02000000:25.0:1550079903.945685:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.18.21@o2ib6 (stopping)
00010000:02000000:27.0:1550079903.978988:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.32@o2ib4 (stopping)
00010000:02000000:25.0:1550079904.027343:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.11@o2ib4 (stopping)
00010000:02000000:25.0:1550079904.040796:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.13.21@o2ib6 (stopping)
00010000:02000000:38.0:1550079904.042589:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.43@o2ib4 (stopping)
00010000:02000000:36.0:1550079904.130962:0:21809:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.38@o2ib4 (stopping)
00010000:02000000:25.0:1550079904.179667:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.39@o2ib4 (stopping)
00000004:00000080:8.0:1550079904.208978:0:21839:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x17d:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079904.209174:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x171:0x0] from 18446744073709551615 #0
00000004:00000080:0.0:1550079904.209176:0:21773:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x16f:0x0] from 18446744073709551615 #0
00000004:00000080:8.0:1550079904.209207:0:21839:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x17b:0x0] from 18446744073709551615 #0
00000004:00000080:32.0:1550079904.209233:0:20525:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x16e:0x0] from 18446744073709551615 #0
00000004:00000080:0.0:1550079904.209279:0:21773:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x189:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079904.209281:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x16a:0x0] from 18446744073709551615 #0
00000004:00000080:8.0:1550079904.209282:0:21839:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0x17e:0x0] from 18446744073709551615 #0
00000004:00000080:0.0:1550079904.209350:0:21773:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000017d5:0x11e:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079904.209652:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0xed:0x0] from 18446744073709551615 #0
00000004:00000080:36.0:1550079904.209781:0:21809:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000036fe:0x1d2:0x0] from 18446744073709551615 #0
00000004:00000080:8.0:1550079904.213444:0:21839:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x200003fde:0xef:0x0] from 18446744073709551615 #0
00000004:00000080:12.0:1550079904.213448:0:21792:0:(mdt_handler.c:6247:mdt_fid2path()) path get [0x2000017d5:0x11c:0x0] from 18446744073709551615 #0
00000004:00000080:12.0:1550079904.214551:0:21792:0:(mdt_handler.c:6431:mdt_iocontrol()) handling ioctl cmd 0x424066b3
00000004:00000080:12.0:1550079904.214560:0:21792:0:(mdd_device.c:1763:mdd_changelog_clear()) fir-MDD0000: Purge request: id=1, endrec=1475529317
00000040:00080000:12.0:1550079904.214566:0:21792:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x92:0x1:0x0]:0 at index 1 of catalog [0x6:0xa:0x0]
00000004:00000080:12.0:1550079904.214571:0:21792:0:(mdd_device.c:1736:mdd_changelog_clear_cb()) Rewriting changelog user 1 endrec to 1475529317
00000004:00000080:12.0:1550079904.214582:0:21792:0:(mdd_device.c:1801:mdd_changelog_clear()) fir-MDD0000: Purging changelog entries up to 1475529317
00000040:00080000:12.0:1550079904.214612:0:21792:0:(llog_cat.c:770:llog_cat_process_common()) processing log [0x6241:0x1:0x0]:0 at index 23276 of catalog [0x5:0xa:0x0]
00010000:02000000:27.0:1550079904.229742:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.40@o2ib4 (stopping)
00010000:02000000:25.0:1550079904.359824:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.34@o2ib6 (stopping)
00010000:02000000:12.0:1550079904.360165:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.1.19@o2ib6 (stopping)
00010000:02000000:12.0:1550079904.393678:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.34@o2ib6 (stopping)
00010000:02000000:38.0:1550079904.473017:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.10.7@o2ib6 (stopping)
00010000:02000000:38.0:1550079904.510121:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.7.34@o2ib6 (stopping)
00010000:02000000:8.0:1550079904.734352:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.115.4@o2ib4 (stopping)
00010000:02000000:8.0:1550079904.738449:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.29@o2ib6 (stopping)
00000004:00080000:25.0:1550079904.763030:0:20324:0:(osp_sync.c:510:osp_sync_request_commit_cb()) commit req ffff9cd4fe2aad00, transno 34365449546
00010000:02000000:38.0:1550079904.776606:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.3@o2ib4 (stopping)
00010000:02000000:38.0:1550079904.795066:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.30@o2ib4 (stopping)
00010000:02000000:38.0:1550079904.857911:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.6@o2ib6 (stopping)
00010000:02000000:25.0:1550079904.895716:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.68@o2ib4 (stopping)
00010000:02000000:27.0:1550079905.126562:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.15@o2ib4 (stopping)
00010000:02000000:8.0:1550079905.232015:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.28.6@o2ib6 (stopping)
00000001:00080000:22.0:1550079905.287988:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597805 is committed
00000001:00080000:22.0:1550079905.287991:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597804 is committed
00000001:00080000:22.0:1550079905.287992:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597803 is committed
00000001:00080000:22.0:1550079905.287995:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597800 is committed
00000001:00080000:22.0:1550079905.287997:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597799 is committed
00000001:00080000:22.0:1550079905.288003:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597793 is committed
00000001:00080000:22.0:1550079905.288009:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597783 is committed
00000001:00080000:22.0:1550079905.288013:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597778 is committed
00000001:00080000:22.0:1550079905.288023:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597764 is committed
00000001:00080000:22.0:1550079905.288060:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597723 is committed
00000001:00080000:22.0:1550079905.288084:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597693 is committed
00000001:00080000:22.0:1550079905.288089:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597686 is committed
00000001:00080000:22.0:1550079905.288142:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597596 is committed
00000001:00080000:22.0:1550079905.288152:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597580 is committed
00000001:00080000:22.0:1550079905.288212:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597475 is committed
00000001:00080000:22.0:1550079905.288219:0:20475:0:(tgt_lastrcvd.c:898:tgt_cb_last_committed()) fir-MDT0000: transno 38754597466 is committed
00010000:02000000:8.0:1550079905.339433:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.48@o2ib4 (stopping)
00010000:02000000:12.0:1550079905.349665:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.12.33@o2ib6 (stopping)
00010000:02000000:38.0:1550079905.466454:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.23@o2ib4 (stopping)
00010000:02000000:38.0:1550079905.545682:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.7.22@o2ib6 (stopping)
00010000:02000000:25.0:1550079905.559493:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.22.19@o2ib6 (stopping)
00010000:02000000:38.0:1550079905.610050:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.16@o2ib4 (stopping)
00010000:02000000:27.0:1550079905.775981:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.22@o2ib4 (stopping)
00000040:00080000:1.0:1550079905.875572:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3097, 168 off556160
00000040:00080000:25.0:1550079905.891539:0:20811:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3098, 168 off556328
00000001:00080000:25.0:1550079905.891542:0:20811:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597844
00000040:00080000:1.0:1550079905.893446:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3099, 168 off556496
00010000:02000000:27.0:1550079905.902589:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.29@o2ib4 (stopping)
00010000:02000000:30.0:1550079905.905396:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.31.6@o2ib6 (stopping)
00010000:02000000:25.0:1550079905.932778:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.33@o2ib4 (stopping)
00010000:02000000:25.0:1550079905.955611:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.3@o2ib4 (stopping)
00010000:02000000:12.0:1550079905.977477:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.12@o2ib4 (stopping)
00000040:00080000:1.0:1550079906.018035:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3100, 168 off556664
00000040:00080000:1.0:1550079906.026819:0:21962:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3101, 168 off556832
00000001:00080000:1.0:1550079906.026821:0:21962:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597854
00000040:00080000:4.0:1550079906.033771:0:21792:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3102, 168 off557000
00000001:00080000:4.0:1550079906.033775:0:21792:0:(tgt_lastrcvd.c:1869:tgt_txn_stop_cb()) More than one transaction 38754597858
00010000:02000000:25.0:1550079906.035808:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.23@o2ib6 (stopping)
00000040:00080000:12.0:1550079906.036067:0:21608:0:(llog_osd.c:698:llog_osd_write_rec()) added record [0x1:0x6241:0x0].3104, 168 off557224
00010000:02000000:30.0:1550079906.037007:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.32@o2ib4 (stopping)
00010000:02000000:30.0:1550079906.091019:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.14@o2ib4 (stopping)
00010000:02000000:27.0:1550079906.094541:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.69@o2ib4 (stopping)
00010000:02000000:25.0:1550079906.125964:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.49@o2ib4 (stopping)
00010000:02000000:25.0:1550079906.128116:0:20811:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.18@o2ib4 (stopping)
00010000:02000000:27.0:1550079906.240274:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.15@o2ib4 (stopping)
00010000:02000000:13.0:1550079906.294347:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.22@o2ib6 (stopping)
00010000:02000000:13.0:1550079906.373668:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.20@o2ib4 (stopping)
00010000:02000000:4.0:1550079906.375186:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.17@o2ib6 (stopping)
00010000:02000000:13.0:1550079906.383467:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.106.25@o2ib4 (stopping)
00010000:02000000:30.0:1550079906.543935:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.70@o2ib4 (stopping)
00010000:02000000:27.0:1550079906.632055:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.47@o2ib4 (stopping)
00010000:02000000:30.0:1550079906.632913:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.42@o2ib4 (stopping)
00010000:02000000:30.0:1550079906.721032:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.48@o2ib4 (stopping)
00010000:02000000:13.0:1550079906.721188:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.101.15@o2ib4 (stopping)
00010000:02000000:4.0:1550079906.753060:0:21792:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.107.70@o2ib4 (stopping)
00010000:02000000:8.0:1550079906.759415:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.0.62@o2ib4 (stopping)
00010000:02000000:27.0:1550079906.808224:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.48@o2ib4 (stopping)
00010000:02000000:25.0:1550079906.821234:0:22236:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.52@o2ib7 (stopping)
00010000:02000000:25.0:1550079906.821259:0:22236:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.0.10.52@o2ib7 (stopping)
00010000:02000000:8.0:1550079907.001721:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.105.49@o2ib4 (stopping)
00010000:02000000:30.0:1550079907.030318:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.18.13@o2ib6 (stopping)
00010000:02000000:27.0:1550079907.033966:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.102.31@o2ib4 (stopping)
00010000:02000000:30.0:1550079907.035297:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.28.8@o2ib6 (stopping)
00010000:02000000:30.0:1550079907.047954:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.30.34@o2ib6 (stopping)
00010000:02000000:27.0:1550079907.099990:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.49@o2ib4 (stopping)
00010000:02000000:30.0:1550079907.115605:0:21149:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.21@o2ib6 (stopping)
00010000:02000000:38.0:1550079907.195695:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.26.20@o2ib6 (stopping)
00010000:02000000:27.0:1550079907.258500:0:20534:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.12@o2ib4 (stopping)
00010000:02000000:8.0:1550079907.276518:0:21839:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.104.10@o2ib4 (stopping)
00010000:02000000:38.0:1550079907.296709:0:21791:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.24.1@o2ib6 (stopping)
00010000:02000000:13.0:1550079907.351724:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.18.3@o2ib6 (stopping)
00010000:02000000:13.0:1550079907.391252:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.9.103.40@o2ib4 (stopping)
00010000:02000000:13.0:1550079907.405846:0:21804:0:(ldlm_lib.c:1008:target_handle_connect()) fir-MDT0002: Not available for connect from 10.8.8.18@o2ib6 (stopping)
Debug log: 7580 lines, 7580 kept, 0 dropped, 0 bad.