[LU-3116] (lu_object.c:1140:lu_device_fini()) ASSERTION( cfs_atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1

Duplicate — Fri, 19 Apr 2013 10:42:07 +0000

== sanity test 231b: must not assert on fully utilized OST request buffer ============================ 08:46:34 (1365176794)
sanity test_231b: @@@@@@ FAIL: dd of=/mnt/lustre/d0.sanity/d231/f.sanity.231b seek=4 failed
Trace dump:
= /usr/lib64/lustre/tests/test-framework.sh:4019:error_noexit()
= /usr/lib64/lustre/tests/test-framework.sh:4042:error()
= /usr/lib64/lustre/tests/sanity.sh:10989:test_231b()
= /usr/lib64/lustre/tests/test-framework.sh:4281:run_one()
= /usr/lib64/lustre/tests/test-framework.sh:4314:run_one_logged()
= /usr/lib64/lustre/tests/test-framework.sh:4184:run_test()
= /usr/lib64/lustre/tests/sanity.sh:10993:main()
Dumping lctl log to /tmp/test_logs/2013-04-05/064048/sanity.test_231b.*.1365176795.log
fat-amd-2: sh: /tmp/test_logs/2013-04-05/064048/sanity.test_231b.debug_log.fat-amd-2.1365176795.log: No such file or directory
fat-amd-2: sh: line 1: /tmp/test_logs/2013-04-05/064048/sanity.test_231b.dmesg.fat-amd-2.1365176795.log: No such file or directory
fat-amd-4: sh: /tmp/test_logs/2013-04-05/064048/sanity.test_231b.debug_log.fat-amd-4.1365176795.log: No such file or directory
fat-amd-4: sh: line 1: /tmp/test_logs/2013-04-05/064048/sanity.test_231b.dmesg.fat-amd-4.1365176795.log: No such file or directory
client-3: Host key verification failed.
client-3: rsync: connection unexpectedly closed (0 bytes received so far) [sender]
client-3: rsync error: unexplained error (code 255) at io.c(605) [sender=3.0.9]
client-1: Host key verification failed.
client-1: rsync: connection unexpectedly closed (0 bytes received so far) [sender]
client-1: rsync error: unexplained error (code 255) at io.c(605) [sender=3.0.9]
fat-amd-2: Host key verification failed.
fat-amd-2: rsync: connection unexpectedly closed (0 bytes received so far) [sender]
fat-amd-2: rsync error: unexplained error (code 255) at io.c(600) [sender=3.0.6]
fat-amd-4: Host key verification failed.
fat-amd-4: rsync: connection unexpectedly closed (0 bytes received so far) [sender]
fat-amd-4: rsync error: unexplained error (code 255) at io.c(600) [sender=3.0.6]
FAIL 231b (2s)

== sanity test 232: failed lock should not block umount ============================================== 08:46:36 (1365176796)
fail_loc=0x31c
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00650157 s, 161 MB/s
fail_loc=0
10.10.4.133@tcp:/lustre /mnt/lustre lustre rw,flock,user_xattr 0 0
Stopping client client-1.lab.whamcloud.com /mnt/lustre (opts

Message from syslogd@client-1 at Apr 5 08:46:36 ...
kernel:[38113.066284] LustreError: 13233:0:(lu_object.c:1140:lu_device_fini()) ASSERTION( cfs_atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1

38113.066284] LustreError: 13233:0:(lu_object.c:1140:lu_device_fini()) ASSERTION( cfs_atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1
[38113.121791] LustreError: 13233:0:(lu_object.c:1140:lu_device_fini()) LBUG
[38113.150755] Kernel panic - not syncing: LBUG
[38113.177028] Pid: 13233, comm: umount Tainted: GF O 3.6.10-4.fc18.x86_64 #1
[38113.207329] Call Trace:
[38113.231847] [<ffffffff816198db>] panic+0xc1/0x1d0
[38113.258853] [<ffffffffa0270e5b>] lbug_with_loc+0xab/0xc0 [libcfs]
[38113.287243] [<ffffffffa04117ca>] lu_device_fini+0xba/0xc0 [obdclass]
[38113.315819] [<ffffffffa077dd36>] lovsub_device_free+0x66/0x1b0 [lov]
[38113.344302] [<ffffffffa041573e>] lu_stack_fini+0x7e/0xc0 [obdclass]
[38113.372680] [<ffffffffa041abae>] cl_stack_fini+0xe/0x10 [obdclass]
[38113.400736] [<ffffffffa076df69>] lov_device_fini+0x59/0x120 [lov]
[38113.428380] [<ffffffffa0415709>] lu_stack_fini+0x49/0xc0 [obdclass]
[38113.456371] [<ffffffffa041abae>] cl_stack_fini+0xe/0x10 [obdclass]
[38113.484215] [<ffffffffa09f7f31>] cl_sb_fini+0x61/0x1a0 [lustre]
[38113.511615] [<ffffffffa09b9ae4>] client_common_put_super+0x54/0x7c0 [lustre]
[38113.540033] [<ffffffffa09babe4>] ll_put_super+0xd4/0x370 [lustre]
[38113.567259] [<ffffffff811aa7ee>] ? dispose_list+0x3e/0x60
[38113.593435] [<ffffffff81192761>] generic_shutdown_super+0x61/0xe0
[38113.620413] [<ffffffff81192876>] kill_anon_super+0x16/0x30
[38113.646669] [<ffffffffa03fabaa>] lustre_kill_super+0x4a/0x60 [obdclass]
[38113.673853] [<ffffffff81192bf7>] deactivate_locked_super+0x57/0x90
[38113.700213] [<ffffffff811937ae>] deactivate_super+0x4e/0x70
[38113.725516] [<ffffffff811ae167>] mntput_no_expire+0xd7/0x130
[38113.750665] [<ffffffff811af146>] sys_umount+0x76/0x390
[38113.775381] [<ffffffff8162bae9>] system_call_fastpath+0x16/0x1b
[38113.800863] panic occurred, switching back to text console
[38113.831700] -----------~~[ cut here ]~~-----------
[38113.864819] WARNING: at arch/x86/kernel/smp.c:123 native_smp_send_reschedule+0x5b/0x60()
[38113.901721] Hardware name: X8DTT
[38113.932625] Modules linked in: lustre(OF) obdecho(OF) mgc(OF) lov(OF) osc(OF) mdc(OF) lmv(OF) fid(OF) fld(OF) ptlrpc(OF) obdclass(OF) lvfs(OF) nfsv3 nfs_acl nfsv4 auth_rpcgss nfs lockd sunrpc dns_resolver fscache ksocklnd(OF) lnet(OF) sha512_generic libcfs(OF) ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr ib_sa mlx4_ib ib_mad ib_core mlx4_en igb coretemp kvm_intel iTCO_wdt kvm iTCO_vendor_support i7core_edac edac_core ioatdma ptp pps_core lpc_ich dca mlx4_core mfd_core i2c_i801 crc32c_intel serio_raw microcode mgag200 i2c_algo_bit drm_kms_helper ttm drm i2c_core [last unloaded: lvfs]
[38114.133028] Pid: 0, comm: swapper/1 Tainted: GF O 3.6.10-4.fc18.x86_64 #1
[38114.168885] Call Trace:
[38114.198501] <IRQ> [<ffffffff8105c8df>] warn_slowpath_common+0x7f/0xc0
[38114.232115] [<ffffffff8105c93a>] warn_slowpath_null+0x1a/0x20
[38114.264693] [<ffffffff810373fb>] native_smp_send_reschedule+0x5b/0x60
[38114.297691] [<ffffffff8109a284>] trigger_load_balance+0x184/0x220
[38114.329497] [<ffffffff81091029>] scheduler_tick+0x109/0x140
[38114.360258] [<ffffffff8106e02c>] update_process_times+0x6c/0x90
[38114.390716] [<ffffffff810b3bfe>] tick_sched_timer+0x6e/0xe0
[38114.420034] [<ffffffff810843b3>] __run_hrtimer+0x73/0x1d0
[38114.448341] [<ffffffff810b3b90>] ? tick_nohz_handler+0x110/0x110
[38114.477096] [<ffffffff81065516>] ? __do_softirq+0x136/0x210
[38114.504688] [<ffffffff81084cd7>] hrtimer_interrupt+0xf7/0x230
[38114.531404] [<ffffffff8162d5b9>] smp_apic_timer_interrupt+0x69/0x99
[38114.559767] [<ffffffff8162c58a>] apic_timer_interrupt+0x6a/0x70
[38114.593270] <EOI> [<ffffffff810863fe>] ? __raw_notifier_call_chain+0xe/0x10
[38114.624339] [<ffffffff8108dba8>] ? finish_task_switch+0x48/0xe0
[38114.651039] [<ffffffff81622316>] __schedule+0x3c6/0x7a0
[38114.677167] [<ffffffff81622a19>] schedule+0x29/0x70
[38114.703192] [<ffffffff8101d5a0>] cpu_idle+0xf0/0x120
[38114.728941] [<ffffffff816126d9>] start_secondary+0x23e/0x240
[38114.755319] --~~[ end trace 910b76818fbbc889 ]~~--

Whamcloud Community JIRA

[LU-3116] (lu_object.c:1140:lu_device_fini()) ASSERTION( cfs_atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1