[LU-5905] Interop 2.6.0<->master conf-sanity test_56: import is not in FULL state

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.7.0, Lustre 2.5.4
• Affects Version/s: Lustre 2.7.0, Lustre 2.5.4
• Environment: server: 2.6.0; client: lustre-master build # 2733
• Severity: 3
• Assignee: WC Triage
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: https://testing.hpdd.intel.com/test_sets/ecdcd6b4-68fc-11e4-9444-5254006e85c2.

The sub-test test_56 failed with the following error:

import is not in FULL state

22:59:25:Lustre: DEBUG MARKER: lctl set_param -n mdt.lustre*.enable_remote_dir=1
22:59:25:LustreError: 14098:0:(osd_io.c:1273:osd_ldiskfs_read()) lustre-MDT0000: can't read 8@8000 on ino 106: rc = 0
22:59:25:LustreError: 14098:0:(osp_dev.c:188:osp_init_last_objid()) lustre-OST03e8-osc-MDT0000: can't initialize lov_objid: rc = -14
22:59:25:LustreError: 14098:0:(osp_dev.c:242:osp_last_used_init()) lustre-OST03e8-osc-MDT0000: Can not get ids -14 from old objid!
22:59:25:LustreError: 14098:0:(obd_config.c:568:class_setup()) setup lustre-OST03e8-osc-MDT0000 failed (-14)
22:59:25:LustreError: 14098:0:(obd_config.c:1720:class_config_llog_handler()) MGC10.2.4.225@tcp: cfg command failed: rc = -14
22:59:25:Lustre:    cmd=cf003 0:lustre-OST03e8-osc-MDT0000  1:lustre-OST03e8_UUID  2:10.2.4.226@tcp  
22:59:25:
22:59:25:LustreError: 13810:0:(mgc_request.c:517:do_requeue()) failed processing log: -14
22:59:25:Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version
22:59:25:Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version
22:59:25:Lustre: DEBUG MARKER: lctl list_param osc.lustre-OST*-osc             > /dev/null 2>&1
22:59:25:Lustre: DEBUG MARKER: lctl get_param -n at_min
22:59:25:Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lust
22:59:25:Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST2710-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
22:59:25:Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST2710-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
22:59:25:Lustre: DEBUG MARKER: osc.lustre-OST2710-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
22:59:25:Lustre: DEBUG MARKER: osc.lustre-OST2710-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
23:00:27:Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version
23:00:27:Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version
23:00:27:Lustre: DEBUG MARKER: lctl list_param osc.lustre-OST*-osc             > /dev/null 2>&1
23:00:27:Lustre: DEBUG MARKER: lctl get_param -n at_min
23:00:27:Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests//usr/lib64/lustre/tests:/usr/lib64/lustre/tests:/usr/lib64/lustre/tests/../utils:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lust
23:00:27:Lustre: DEBUG MARKER: /usr/sbin/lctl mark  rpc : @@@@@@ FAIL: can\'t put import for osc.lustre-OST03e8-osc-MDT0000.ost_server_uuid into FULL state after 40 sec, have  
23:00:27:Lustre: DEBUG MARKER: /usr/sbin/lctl mark  rpc : @@@@@@ FAIL: can\'t put import for osc.lustre-OST03e8-osc-MDT0000.ost_server_uuid into FULL state after 40 sec, have  
23:00:27:Lustre: DEBUG MARKER: rpc : @@@@@@ FAIL: can't put import for osc.lustre-OST03e8-osc-MDT0000.ost_server_uuid into FULL state after 40 sec, have

Info required for matching: conf-sanity 56

Comments

[Jian Yu]

Patches landed to master and b2_5 branches.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/13046/
Subject: LU-5905 tests: add version check codes to conf-sanity test 56
Project: fs/lustre-release
Branch: b2_5
Current Patch Set:
Commit: ee5e67a03e92d47f50a9b5d1371a8548d44732df

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/13045/
Subject: LU-5905 tests: add version check codes to conf-sanity test 56
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: a907b76e41a12d51ec780661dbe25735b1dea8a2

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: http://review.whamcloud.com/13046
Subject: LU-5905 tests: add version check codes to conf-sanity test 56
Project: fs/lustre-release
Branch: b2_5
Current Patch Set: 1
Commit: f426324f0e724a2ef8f019e2d5bed3d704bb01da

[Gerrit Updater]

Jian Yu ([e-mail]) uploaded a new patch: http://review.whamcloud.com/13045
Subject: LU-5905 tests: add version check codes to conf-sanity test 56
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d755b5af96acf8cf2d7f1978dfe54359d635fbfa

[Jian Yu]

Lustre client build: https://build.hpdd.intel.com/job/lustre-b2_5/104
Lustre server build: https://build.hpdd.intel.com/job/lustre-b2_4/73 (2.4.3)

conf-sanity test 56 hit the same failure:
https://testing.hpdd.intel.com/test_sets/57a2934a-7a68-11e4-be53-5254006e85c2

[Andreas Dilger]

It looks like there was a patch landed to change this test v2_6_53_0-29-g3dc2329:

commit 3dc232918c7c9b95398ac6a0dc4c2130adc2851d
Author: Li Wei <[e-mail]>
Date:   Wed Sep 24 12:12:37 2014 +0800

LU-5654 osd-ldiskfs: Handle holes in osd_ldiskfs_read()
    
Current osd_ldiskfs_read() incorrectly returns zero and leaves the
corresponding portion of the buffer untouched when a block to be read
is not allocated.
    
Test-Parameters: testlist=conf-sanity,conf-sanity,conf-sanity,conf-sanity,conf-sanity
Change-Id: I3044f771fccfdddf1fee0c931e8996cbdd8df0c8
Signed-off-by: Li Wei <[e-mail]>
Reviewed-on: http://review.whamcloud.com/12145

Is it possible this patch is causing the 2.6 server to fail?