[LU-15760] Interop: conf-sanity test 32a: import.c:354:ptlrpc_invalidate_import()) .._UUID: timeout waiting for callback (1 != 0)

Wed, 20 Apr 2022 17:48:01 +0000

This issue was created by maloo for Cliff White <cwhite@whamcloud.com>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/365325fe-c029-428d-b2cc-10fc8168c41a

Suite reported as TIMEOUT, system appears to have gone sideways after conf-sanity:

[14952.187746] Lustre: Mounted t32fs-client
[14958.018350] LustreError: 307065:0:(import.c:354:ptlrpc_invalidate_import()) t32fs-OST0000_UUID: timeout waiting for callback (1 != 0)
[14958.020767] LustreError: 307065:0:(import.c:377:ptlrpc_invalidate_import()) @@@ still on sending list  req@000000006226d64a x1729124573906368/t0(0) o8->t32fs-OST0000-osc-ffff88a122472000@10.10.4.134@tcp:28/4 lens 520/544 e 0 to 0 dl 1649022164 ref 2 fl UnregRPC:ENU/0/ffffffff rc -5/-1 job:'mount.lustre.0'
[14958.025706] LustreError: 307065:0:(import.c:388:ptlrpc_invalidate_import()) t32fs-OST0000_UUID: Unregistering RPCs found (1). Network is sluggish? Waiting for them to error out.
[14971.598731] Lustre: Unmounted t32fs-client
[15278.412748] Lustre: DEBUG MARKER: /usr/sbin/lctl mark  conf-sanity test_32a: @@@@@@ FAIL: Reloading modules 
[15278.776211] Lustre: DEBUG MARKER: conf-sanity test_32a: @@@@@@ FAIL: Reloading modules
[15279.171140] Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2022-04-03/lustre-master_full-part-3_4283_1_27_9ac822a6-39da-44b1-9b2f-47b5efb55dbb//conf-sanity.test_32a.debug_log.$(hostname -s).1649022486.log;
		dmesg > /autotest/autotest-1/2022-04-03/lustre-master_full-part-3
[15281.592870] Lustre: DEBUG MARKER: /usr/sbin/lctl mark == conf-sanity testing \/usr\/lib64\/lustre\/tests\/disk2_7-ldiskfs.tar.bz2 upgrade ========================================================== 21:48:08 \(1649022488\)
[15281.941292] Lustre: DEBUG MARKER: == conf-sanity testing /usr/lib64/lustre/tests/disk2_7-ldiskfs.tar.bz2 upgrade ========================================================== 21:48:08 (1649022488)
[15927.182151] LustreError: 11-0: t32fs-MDT0000-mdc-ffff88a0c3d46000: operation mds_connect to node 10.240.42.39@tcp failed: rc = -11

System starts stack dump after this.

Whamcloud Community JIRA

[LU-15760] Interop: conf-sanity test 32a: import.c:354:ptlrpc_invalidate_import()) .._UUID: timeout waiting for callback (1 != 0)