[LU-4406] conf-sanity test_32a: Upgrade from b2_4-zfs to master failed

• Status: Closed
• Project: Lustre
• Affects Version/s: Lustre 2.6.0
• Fix Version/s: Lustre 2.6.0
• Type: Bug
• Priority: Blocker
• Reporter: Maloo
• Assignee: Nathaniel Clark
• Resolution: Fixed
• Labels: MB
• Severity: 3

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: http://maloo.whamcloud.com/test_sets/d6c0ccf4-67a0-11e3-8bcb-52540035b04c.

The sub-test test_32a failed with the following error:

test_32a failed with 1

Hit following error when running conf-sanity test-32a with b2_4-zfs image.
Here is the debug log

00080000:00000001:12.0:1387588620.586102:0:11498:0:(osd_index.c:1312:osd_index_it_load()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:12.0:1387588620.586108:0:11498:0:(osd_index.c:1267:osd_index_it_rec()) Process entered
00080000:00000001:12.0:1387588620.586135:0:11498:0:(osd_index.c:1279:osd_index_it_rec()) Process leaving (rc=18446744073709551614 : -2 : fffffffffffffffe)
80000000:00000001:12.0:1387588620.586139:0:11498:0:(fld_index.c:389:fld_index_init()) Process leaving via out_it_put (rc=18446744073709551614 : -2 : 0xfffffffffffffffe)
00080000:00000001:12.0:1387588620.586145:0:11498:0:(osd_index.c:107:osd_index_it_fini()) Process entered
00000020:00000001:12.0:1387588620.586153:0:11498:0:(lustre_fid.h:719:fid_flatten32()) Process leaving (rc=4099 : 4099 : 1003)
00080000:00000001:12.0:1387588620.586156:0:11498:0:(osd_index.c:117:osd_index_it_fini()) Process leaving
80000000:00000010:12.0:1387588620.586159:0:11498:0:(fld_index.c:425:fld_index_init()) kfreed 'attr': 80 at ffff880319c76940.
00000020:00000001:12.0:1387588620.586162:0:11498:0:(lustre_fid.h:719:fid_flatten32()) Process leaving (rc=4099 : 4099 : 1003)
80000000:00000001:12.0:1387588620.586167:0:11498:0:(fld_index.c:432:fld_index_init()) Process leaving (rc=18446744073709551614 : -2 : fffffffffffffffe)
80000000:00000001:12.0:1387588620.586171:0:11498:0:(fld_handler.c:470:fld_server_init()) Process leaving via out_cache (rc=18446744073709551614 : -2 : 0xfffffffffffffffe)
80000000:00000001:12.0:1387588620.586175:0:11498:0:(fld_cache.c:102:fld_cache_fini()) Process entered
80000000:00000001:12.0:1387588620.586177:0:11498:0:(fld_cache.c:255:fld_cache_flush()) Process entered
80000000:00000001:12.0:1387588620.586179:0:11498:0:(fld_cache.c:226:fld_cache_shrink()) Process entered
80000000:00000040:12.0:1387588620.586181:0:11498:0:(fld_cache.c:245:fld_cache_shrink()) srv-t32fs-MDT0000: FLD cache - Shrunk by 0 entries
80000000:00000001:12.0:1387588620.586184:0:11498:0:(fld_cache.c:247:fld_cache_shrink()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:12.0:1387588620.586186:0:11498:0:(fld_cache.c:262:fld_cache_flush()) Process leaving
80000000:00000040:12.0:1387588620.586188:0:11498:0:(fld_cache.c:114:fld_cache_fini()) FLD cache statistics (srv-t32fs-MDT0000):
80000000:00000040:12.0:1387588620.586190:0:11498:0:(fld_cache.c:115:fld_cache_fini())   Total reqs: 0
80000000:00000040:12.0:1387588620.586192:0:11498:0:(fld_cache.c:116:fld_cache_fini())   Cache reqs: 0
80000000:00000040:12.0:1387588620.586194:0:11498:0:(fld_cache.c:117:fld_cache_fini())   Cache hits: 0%
80000000:00000010:12.0:1387588620.586196:0:11498:0:(fld_cache.c:119:fld_cache_fini()) kfreed 'cache': 152 at ffff880319c6eb00.
80000000:00000001:12.0:1387588620.586199:0:11498:0:(fld_cache.c:121:fld_cache_fini()) Process leaving
00000004:00000010:12.0:1387588620.586201:0:11498:0:(mdt_handler.c:3630:mdt_fld_init()) kfreed 'ss->ss_server_fld': 152 at ffff880319c6e980.
00000004:00000001:12.0:1387588620.586204:0:11498:0:(mdt_handler.c:3632:mdt_fld_init()) Process leaving (rc=18446744073709551614 : -2 : fffffffffffffffe)
00000004:00000001:12.0:1387588620.586207:0:11498:0:(mdt_handler.c:4347:mdt_init0()) Process leaving via err_fini_stack (rc=18446744073709551614 : -2 : 0xfffffffffffffffe)

Issue Links

• is blocking: LU-2687 create conf-sanity.sh test_32 ZFS upg...

Comments

[Di Wang]

Hmm, it seems it is failed during load FLDB into memory. According to the test results lists in http://review.whamcloud.com/#/c/7193/. It seems the problem is brought in since Nov 20th. Probably related with this,
commit e84d60ea58e5d236a35eb128e73b6ca4c567373d
Author: Alex Zhuravlev <[e-mail]>
Date: Sun Jul 28 11:33:20 2013 +0400

LU-3489 osd-zfs: varsize index support

LFSCK needs indices with keys/values of different size.
add a support for this to osd-zfs. key/value size can't
vary within a single index object so far.

Signed-off-by: Alex Zhuravlev <[e-mail]>
Change-Id: I6faa730ce1f778563c1fcf43d3b50c5b62c899d9
Reviewed-on: http://review.whamcloud.com/7152
Tested-by: Jenkins
Reviewed-by: Andreas Dilger <[e-mail]>
Tested-by: Maloo <[e-mail]>
Reviewed-by: Nathaniel Clark <[e-mail]>
Reviewed-by: Fan Yong <[e-mail]>
Reviewed-by: Oleg Drokin <[e-mail]>

Alex, Please comment. It is just some wild guess. Thanks.

[Jodi Levi (Inactive)]

Nathaniel,
Could you have a look at this ticket? Please talk to Alex if you have questions or need more information.
Thank you!

[Nathaniel Clark]

Found issue with #7152 fixed and made #7193 dependent on this patch:

http://review.whamcloud.com/8857