Details
-
Bug
-
Resolution: Duplicate
-
Blocker
-
None
-
Lustre 2.3.0
-
None
-
3
-
6350
Description
This issue was created by maloo for sarah <sarah@whamcloud.com>
This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/8220cf66-e4f5-11e1-9681-52540035b04c.
The sub-test test_1c failed with the following error:
test failed to respond and timed out
12:46:22:Lustre: DEBUG MARKER: == obdfilter-survey test 1c: Object Storage Targets survey, big batch == 12:46:20 (1344800780) 12:46:22:Lustre: DEBUG MARKER: lctl dl | grep obdfilter 12:46:23:Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep tcp | cut -f 1 -d '@' 12:46:23:Lustre: Echo OBD driver; http://www.lustre.org/ 12:47:02:Lustre: 5083:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0002: slow direct_io 32s 12:47:05:Lustre: 5419:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0002: slow direct_io 30s 12:47:06:Lustre: 5364:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0002: slow direct_io 31s 12:47:06:Lustre: 5364:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 9 previous similar messages 12:47:08:Lustre: 5086:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0001: slow direct_io 38s 12:47:08:Lustre: 5086:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 17 previous similar messages 12:47:09:Lustre: 5705:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0001: slow direct_io 34s 12:47:09:Lustre: 5705:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 38 previous similar messages 12:47:13:Lustre: 5706:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0001: slow direct_io 38s 12:47:13:Lustre: 5706:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 47 previous similar messages 12:47:22:Lustre: 5346:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0005: slow direct_io 36s 12:47:24:Lustre: 5346:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 155 previous similar messages 12:47:38:Lustre: 5220:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0004: slow direct_io 36s 12:47:39:Lustre: 5220:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 271 previous similar messages 12:48:11:Lustre: 5628:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0000: slow direct_io 33s 12:48:11:Lustre: 5628:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 492 previous similar messages 12:49:15:Lustre: 5901:0:(filter_io_26.c:772:filter_commitrw_write()) lustre-OST0005: slow direct_io 30s 12:49:16:Lustre: 5901:0:(filter_io_26.c:772:filter_commitrw_write()) Skipped 1089 previous similar messages 12:52:38:INFO: task jbd2/dm-0-8:29189 blocked for more than 120 seconds. 12:52:38:"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. 12:52:38:jbd2/dm-0-8 D 0000000000000000 0 29189 2 0x00000080 12:52:38: ffff880069127d20 0000000000000046 ffff880069127c90 ffffffff810920e6 12:52:38: ffff880069127cd0 ffffffff81039678 ffff8800ffffffff ffff880069938040 12:52:38: ffff8800699385f8 ffff880069127fd8 000000000000fb88 ffff8800699385f8 12:52:38:Call Trace: 12:52:38: [<ffffffff810920e6>] ? autoremove_wake_function+0x16/0x40 12:52:38: [<ffffffff81039678>] ? pvclock_clocksource_read+0x58/0xd0 12:52:38: [<ffffffff810923be>] ? prepare_to_wait+0x4e/0x80 12:52:38: [<ffffffffa03a493f>] jbd2_journal_commit_transaction+0x19f/0x1530 [jbd2] 12:52:38: [<ffffffff810096f0>] ? __switch_to+0xd0/0x320 12:52:38: [<ffffffff8107e00c>] ? lock_timer_base+0x3c/0x70 12:52:38: [<ffffffff810920d0>] ? autoremove_wake_function+0x0/0x40 12:52:38: [<ffffffffa03ab128>] kjournald2+0xb8/0x220 [jbd2] 12:52:38: [<ffffffff810920d0>] ? autoremove_wake_function+0x0/0x40 12:52:38: [<ffffffffa03ab070>] ? kjournald2+0x0/0x220 [jbd2] 12:52:38: [<ffffffff81091d66>] kthread+0x96/0xa0 12:52:38: [<ffffffff8100c14a>] child_rip+0xa/0x20 12:52:38: [<ffffffff81091cd0>] ? kthread+0x0/0xa0 12:52:38: [<ffffffff8100c140>] ? child_rip+0x0/0x20