[LU-797] Test failure on test suite ost-pools, subtest test_14, test_18, test_23

• Type: Bug
• Resolution: Fixed
• Priority: Blocker
• Fix Version/s: Lustre 2.4.0, Lustre 2.1.4, Lustre 1.8.9
• Affects Version/s: Lustre 2.2.0, Lustre 2.1.2, Lustre 2.1.3, Lustre 2.1.4, Lustre 1.8.8
• Severity: 3
• Assignee: Niu Yawei (Inactive)
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/f6c809ee-00ec-11e1-bb4f-52540025f9af.

The sub-test test_14 failed with the following error:

test failed to respond and timed out

Info required for matching: ost-pools 14

Issue Links

• is duplicated by: LU-1001 Test failure on test suite ost-pools, subtest test_18
• is duplicated by: LU-876 Improvement to ost-pools.sh
• Trackbacks: Lustre 1.8.7-wc1 release testing tracker Lustre 1.8.7wc1 RC2 Tag: v187WC1RC2 Build:
• Trackbacks: Lustre 1.8.8-wc1 release testing tracker Lustre 1.8.8wc1 RC2 Tag: v188WC1RC2 Build:
• Trackbacks: Lustre 2.1.1 release testing tracker Lustre 2.1.1 RC4 Tag: v2110RC4 Build:
• Trackbacks: Lustre 2.1.2 release testing tracker Lustre 2.1.2 RC2 Tag: v212RC2 Build:
• Trackbacks: Lustre 2.1.3 release testing tracker Lustre 2.1.3 RC1 Tag: v213RC1 Build:
• Trackbacks: Changelog 2.1 Changes from version 2.1.0 to version 2.1.1 Server support for kernels: 2.6.18274.12.1.el5 (RHEL5) 2.6.32220.el6 (RHEL6) Client support for unpatched kernels: 2.6.18274.12.1.el5 (RHEL5) 2.6.32220.el6 (RHEL6) 2.6.32.360....
• Trackbacks: Changelog 2.2 version 2.2.0 Support for networks: o2iblnd OFED 1.5.4 Server support for kernels: 2.6.32220.4.2.el6 (RHEL6) Client support for unpatched kernels: 2.6.18274.18.1.el5 (RHEL5) 2.6.32220.4.2.el6 (RHEL6) 2.6.32.360....

Comments

[Jian Yu]

More instances occurred during Lustre 2.1.3 RC2 testing:
https://maloo.whamcloud.com/test_sets/9c6295ce-eb32-11e1-ba73-52540035b04c
https://maloo.whamcloud.com/test_sets/68c13076-eb3d-11e1-ba73-52540035b04c

[Jian Yu]

More instances occurred during Lustre 2.1.3 RC1 testing:
https://maloo.whamcloud.com/test_sets/b66fac84-e490-11e1-af05-52540035b04c
https://maloo.whamcloud.com/test_sets/759997b4-e4be-11e1-af05-52540035b04c
https://maloo.whamcloud.com/test_sets/615958d4-e3ec-11e1-b6d3-52540035b04c

[Jian Yu]

Note also that I have a second patch which is skipping test_23b() when SLOW=no, because I don't think this is a very useful test (http://review.whamcloud.com/2091).

During the build/release testing cycle, all of the auster tests are run with SLOW=yes, so the ost-pools test 23b timeout issue still exists with large size OSTs:
http://tinyurl.com/c4gxcbn

[Jian Yu]

Lustre Tag: v2_1_2_RC2
Lustre Build: http://build.whamcloud.com/job/lustre-b2_1/86/
Distro/Arch: RHEL6.2/x86_64(server), RHEL6.2/i686(client)
Network: TCP (1GigE)
ENABLE_QUOTA=yes

ost-pools test 23b timed out: https://maloo.whamcloud.com/test_sets/7d305f1e-aa33-11e1-971d-52540035b04c

[Jian Yu]

Lustre Tag: v1_8_8_WC1_RC2
Lustre Build: http://build.whamcloud.com/job/lustre-b1_8/197/
Distro/Arch: RHEL5.8/x86_64 (kernel version: 2.6.18-308.4.1.el5)
Network: TCP (1GigE)
ENABLE_QUOTA=yes

ost-pools test 14 timed out: https://maloo.whamcloud.com/test_sets/23fdf678-a258-11e1-a6cd-52540035b04c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,ofa #480
LU-797 tests: speed up ost-pools tests (Revision eea698c944283b755882d8f504d2fcc8ea371bd8)
LU-797 tests: skip ost-pools.sh 23b when SLOW=no (Revision f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212)

Result = ABORTED
Oleg Drokin : eea698c944283b755882d8f504d2fcc8ea371bd8
Files :

• lustre/tests/ost-pools.sh
• lustre/tests/test-framework.sh

Oleg Drokin : f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212
Files :

• lustre/tests/ost-pools.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,ofa #480
LU-797 tests: speed up ost-pools tests (Revision eea698c944283b755882d8f504d2fcc8ea371bd8)
LU-797 tests: skip ost-pools.sh 23b when SLOW=no (Revision f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212)

Result = FAILURE
Oleg Drokin : eea698c944283b755882d8f504d2fcc8ea371bd8
Files :

• lustre/tests/ost-pools.sh
• lustre/tests/test-framework.sh

Oleg Drokin : f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212
Files :

• lustre/tests/ost-pools.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,ofa #480
LU-797 tests: speed up ost-pools tests (Revision eea698c944283b755882d8f504d2fcc8ea371bd8)
LU-797 tests: skip ost-pools.sh 23b when SLOW=no (Revision f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212)

Result = FAILURE
Oleg Drokin : eea698c944283b755882d8f504d2fcc8ea371bd8
Files :

• lustre/tests/test-framework.sh
• lustre/tests/ost-pools.sh

Oleg Drokin : f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212
Files :

• lustre/tests/ost-pools.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #472
LU-797 tests: skip ost-pools.sh 23b when SLOW=no (Revision f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212)

Result = SUCCESS
Oleg Drokin : f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212
Files :

• lustre/tests/ost-pools.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #472
LU-797 tests: skip ost-pools.sh 23b when SLOW=no (Revision f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212)

Result = SUCCESS
Oleg Drokin : f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212
Files :

• lustre/tests/ost-pools.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #472
LU-797 tests: skip ost-pools.sh 23b when SLOW=no (Revision f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212)

Result = SUCCESS
Oleg Drokin : f7b4054cfc1d30fbbfd56acfe4b5a7a334de8212
Files :

• lustre/tests/ost-pools.sh