[LU-5713] Interop 2.5<->2.7 sanity-lfsck test_8: (mdt_handler.c:4378:mdt_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed

• Type: Bug
• Resolution: Cannot Reproduce
• Priority: Minor
• Affects Version/s: Lustre 2.7.0, Lustre 2.8.0
• Environment: server: lustre-master build # 2671; client: 2.5.3
• Severity: 3
• Assignee: WC Triage
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/34941bc6-4732-11e4-8a80-5254006e85c2.

The sub-test test_8 failed with the following error:

test failed to respond and timed out

MDS console

09:49:10:Lustre: DEBUG MARKER: == sanity-lfsck test 8: LFSCK state machine == 15:48:59 (1411832939)
09:49:10:Lustre: DEBUG MARKER: grep -c /mnt/mds1' ' /proc/mounts
09:49:10:Lustre: DEBUG MARKER: umount -d -f /mnt/mds1
09:49:10:LustreError: 24584:0:(qsd_reint.c:54:qsd_reint_completion()) lustre-MDT0000: failed to enqueue global quota lock, glb fid:[0x200000006:0x10000:0x0], rc:-5
09:49:10:LustreError: 24584:0:(qsd_reint.c:54:qsd_reint_completion()) Skipped 2 previous similar messages
09:49:10:LustreError: 25070:0:(ldlm_lib.c:2106:target_stop_recovery_thread()) lustre-MDT0000: Aborting recovery
09:49:10:Lustre: 24587:0:(ldlm_lib.c:1781:target_recovery_overseer()) recovery is aborted, evict exports in recovery
09:49:10:LustreError: 24567:0:(osp_precreate.c:725:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: cannot cleanup orphans: rc = -5
09:49:10:LustreError: 24569:0:(osp_precreate.c:466:osp_precreate_send()) lustre-OST0001-osc-MDT0000: can't precreate: rc = -5
09:49:10:LustreError: 24569:0:(osp_precreate.c:976:osp_precreate_thread()) lustre-OST0001-osc-MDT0000: cannot precreate objects: rc = -5
09:49:10:Lustre: *** cfs_fail_loc=1602, val=0***
09:49:10:LustreError: 2658:0:(client.c:1075:ptlrpc_import_delay_req()) @@@ IMP_CLOSED   req@ffff88007be6f400 x1480397462816312/t0(0) o13->lustre-OST0001-osc-MDT0000@10.1.6.53@tcp:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1
09:49:10:LustreError: 2658:0:(client.c:1075:ptlrpc_import_delay_req()) Skipped 12 previous similar messages
09:49:10:LustreError: 2643:0:(lod_dev.c:913:lod_device_free()) ASSERTION( atomic_read(&lu->ld_ref) == 0 ) failed: 
09:49:10:LustreError: 25070:0:(mdt_handler.c:4378:mdt_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: 
09:49:10:LustreError: 25070:0:(mdt_handler.c:4378:mdt_fini()) LBUG
09:49:10:Pid: 25070, comm: umount
09:49:10:
09:49:10:Call Trace:
09:49:10: [<ffffffffa0483895>] libcfs_debug_dumpstack+0x55/0x80 [libcfs]
09:49:10: [<ffffffffa0483e97>] lbug_with_loc+0x47/0xb0 [libcfs]
09:49:10: [<ffffffffa0ecbb9f>] mdt_device_fini+0xc8f/0xcd0 [mdt]
09:49:10: [<ffffffffa05b95d6>] ? class_disconnect_exports+0x116/0x2f0 [obdclass]
09:49:10: [<ffffffffa05d8f52>] class_cleanup+0x562/0xd20 [obdclass]
09:49:10: [<ffffffffa05b6f16>] ? class_name2dev+0x56/0xe0 [obdclass]
09:49:10: [<ffffffffa05dac6a>] class_process_config+0x155a/0x1ac0 [obdclass]
09:49:10: [<ffffffffa05d39b5>] ? lustre_cfg_new+0x4f5/0x6f0 [obdclass]
09:49:10: [<ffffffffa05db347>] class_manual_cleanup+0x177/0x700 [obdclass]
09:49:10: [<ffffffffa05b6f16>] ? class_name2dev+0x56/0xe0 [obdclass]
09:49:10: [<ffffffffa0617a57>] server_put_super+0xb37/0xe50 [obdclass]
09:49:10: [<ffffffff8118b63b>] generic_shutdown_super+0x5b/0xe0
09:49:10: [<ffffffff8118b726>] kill_anon_super+0x16/0x60
09:49:10: [<ffffffffa05dd246>] lustre_kill_super+0x36/0x60 [obdclass]
09:49:10: [<ffffffff8118bec7>] deactivate_super+0x57/0x80
09:49:10: [<ffffffff811ab8cf>] mntput_no_expire+0xbf/0x110
09:49:10: [<ffffffff811ac41b>] sys_umount+0x7b/0x3a0
09:49:10: [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
09:49:10:
09:49:10:LustreError: 2643:0:(lod_dev.c:913:lod_device_free()) LBUG
09:49:10:Pid: 2643, comm: obd_zombid

Info required for matching: sanity-lfsck 8

Issue Links

• is related to: LU-4595 lod_device_free()) ASSERTION( atomic_read(&lu->ld_ref) == 0 ) failed