[LU-6660] interop DNE2 test between 2.5/2.7 clients and DNE2 servers

• Type: Task
• Resolution: Fixed
• Priority: Blocker
• Fix Version/s: Lustre 2.8.0
• Assignee: Lai Siyao
• Reporter: Di Wang

Description

This test is to verify 2.5/2.7 clients can work with DNE2 servers.
For DNE2 server, it can use this build
https://build.hpdd.intel.com/job/lustre-reviews/32529/

2.5/2.7 client can use the most update rpm in the build.
https://build.hpdd.intel.com

Right now, we can check these two things.

1. Sanity should pass as other inter-op test.
2. check if "lfs mkdir" and "lfs mv" works in this environment.

Issue Links

• is blocking: LU-6858 Demonstrate DNE2 functionality
• is related to: LU-3531 DNE2: striped directory

Comments

[Jessica A. Popp (Inactive)]

Lai - Have you had a chance to to verify now that the patch has landed?

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch http://review.whamcloud.com/15323/
Subject: LU-6660 rename: DNE2 should return -EXDEV upon remote rename
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 31234e608fa156761b2d8c48ff60cba875dd4832

[Lai Siyao]

Richard, you may wait for some time, cause when all patches landed, I'd like to test again to verify.

[Richard Henwood (Inactive)]

Lai,

Can this ticket be closed?

[Lai Siyao]

yes, Andreas.

I'll do it later.

[Andreas Dilger]

Lai, to confirm - the test failures in your last comment are when runnin with patch 15323 applied, and without that patch there are more failures due to -EREMOTE being returned to the client?

It might be useful to submit patches to b2_5_fe and b2_7_fe to skip the SOM test 132.

[Lai Siyao]

2.5 client failed tests:
132: failed because SOM is removed from master.
151,156: failed because lproc stats format changed, after I changed to use DNE2 format, tests can pass.
154a: failed because of LU-5424, which is not in 2.5, and 2.7 test script adds version check.

2.7 client failed tests:
132: failed because SOM is removed from master.

[Gerrit Updater]

Lai Siyao ([e-mail]) uploaded a new patch: http://review.whamcloud.com/15323
Subject: LU-6660 rename: DNE2 should return -EXDEV upon remote rename
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: b08334081bbfb07958cc51ceda785c1bff784252

[Lai Siyao]

Indeed, this was introduced by http://review.whamcloud.com/#/c/12282/47 for LU-3537, which adds support for cross-MDT rename, so once cross-MDT detected, DNE2 MDS return -EREMOTE, and LMV will retry with correct MDS. I'll add interop code to address this issue.

[Andreas Dilger]

I'm not sure I understand about 2.7 clients and -EREMOTE? 2.7 clients DO support striped directories, but renames across stripes should return -EXDEV so that user space tools can handle this properly. If the Async commit causes clients to return -EREMOTE to applications then "mv" and other tools will fail.

[Lai Siyao]

https://testing.hpdd.intel.com/test_sets/bd8ddb6c-0e27-11e5-a0ac-5254006e85c2 sanity test failures 24b, 24f, 24x and 27z look to be because DNE2 rename changed semantic, so for striped directory 2.7 client will fail with -EREMOTE, this should not be an issue since this is striped directory. 103b failure looks to be a real issue, and I have reproduced it locally, it looks to be there is an inflight OSP RPC, so OSP device refcount is not NULL upon umount, I'll continue investigating into it.

As for 2.5 a wrong build number is specified in Test-parameters, I'll retrigger auto test.