[LU-12229] ost-pools test 1j fails with 'test_1j returned 1' Created: 26/Apr/19  Updated: 08/Oct/19  Resolved: 04/Oct/19

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.13.0, Lustre 2.12.1
Fix Version/s: Lustre 2.13.0, Lustre 2.12.3

Type: Bug Priority: Minor
Reporter: James Nunez (Inactive) Assignee: Emoly Liu
Resolution: Fixed Votes: 0
Labels: rhel8, ubuntu
Environment:

Ubuntu 18.04 and RHEL 8.0 clients


Issue Links:
Related
is related to LU-10997 Ubuntu 18 support Resolved
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

ost-pools test_1j and test_1k fail with 'test_1j returned 1' and 'test_1k returned 1', respectively, for Ubuntu 18.04 only and fails 100% of the time for Ubuntu 18.04 clients.

Both of these ost-pools tests try to create a pool using a bad format for the pool name. The creation of the pool is expected to fail and non-Ubuntu clients clean up their environment and run the next test. For Ubuntu clients, we see an error at the end of the test. Looking at the suite_log for a recent failure, with logs at https://testing.whamcloud.com/test_sets/423475d4-6661-11e9-aeec-52540065bddc , we see the following error for both tests

/usr/lib64/lustre/tests/test-framework.sh: line 7365: lustre,testpool_CREATED_POOLS: bad substitution

and

/usr/lib64/lustre/tests/test-framework.sh: line 7365: lustre/testpool_CREATED_POOLS: bad substitution

This error is from destroy_pool() calling ‘destroy_pool_int $fsname.$poolname’. destroy_pool() is called because we have a stack_trap in create_pool() and create_pool() is called by both tests.

There are several examples of this failure, but here are just a couple of additional links to logs
https://testing.whamcloud.com/test_sets/e6e31bea-43ec-11e9-8e92-52540065bddc
https://testing.whamcloud.com/test_sets/e9848f38-5fb1-11e9-b98a-52540065bddc
https://testing.whamcloud.com/test_sets/ed973eec-622f-11e9-8bb1-52540065bddc



 Comments   
Comment by Jian Yu [ 27/Aug/19 ]

+1 on master branch with RHEL 8.0 client and server:
https://testing.whamcloud.com/test_sets/56a2de6c-c709-11e9-a25b-52540065bddc

Comment by Peter Jones [ 18/Sep/19 ]

Emoly

Could you please investigate?

Thanks

Peter

Comment by Emoly Liu [ 19/Sep/19 ]

The following test shows there is something changed with shell in RHEL8 and Ubuntu 18:

rhel7:

# a=abc,1
# [ x${!a} = x ] && echo "empty"
empty
# bash --version
GNU bash, version 4.2.46(1)-release (x86_64-redhat-linux-gnu)

rhel8:

# a=abc,1
# [ x${!a} = x ] && echo "empty"
-bash: abc,1: bad substitution
# bash --version
GNU bash, version 4.4.19(1)-release (x86_64-redhat-linux-gnu)

I will submit a patch.

Comment by Gerrit Updater [ 20/Sep/19 ]

Emoly Liu (emoly@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/36243
Subject: LU-12229 tests: fix "bad substitution" error
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 04acc6bd4922d51aa18472f1b2ea308e705a821a

Comment by Gerrit Updater [ 04/Oct/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/36243/
Subject: LU-12229 tests: fix "bad substitution" error
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: ac426d6f17b80ed36052f11b9780fa444cfa24aa

Comment by Peter Jones [ 04/Oct/19 ]

Landed for 2.13

Comment by Gerrit Updater [ 04/Oct/19 ]

Minh Diep (mdiep@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/36377
Subject: LU-12229 tests: fix "bad substitution" error
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 09e4c9b66bbd9b6fd18b29de90a63a9735c70e3f

Comment by Gerrit Updater [ 08/Oct/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/36377/
Subject: LU-12229 tests: fix "bad substitution" error
Project: fs/lustre-release
Branch: b2_12
Current Patch Set:
Commit: f7a138c9afe9ac8a7273bdb622dd00eacd252bcc

Generated at Sat Feb 10 02:50:45 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.