[LU-16837] interop: client skip unknown component mirror

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.16.0
• Type: Improvement
• Priority: Major
• Reporter: Zhenyu Xu
• Assignee: Zhenyu Xu
• Resolution: Fixed
• Labels: compression
• Severity: 3

Description

If the client encounters unknown components in a FLR file, it should skip the mirror to choose another known mirror for read/write.

This provides some forward compatibility for clients accessing mirrored files - they can always read files that have at least one "known" mirror, even if there are other "unknown" mirrors (e.g. compressed, EC, PCC/HSM with some unknown type, etc.).

Issue Links

• is related to: LU-10026 Client-side data compression
• is related to: LU-10606 HSM info as part of LOV layout xattr
• is related to: LU-10911 FLR2: Erasure coding

Comments

[Gerrit Updater]

"Zhenyu Xu <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51060
Subject: LU-16837 llite: handle unknown layout component
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c93adde0919f9afcf8bc98a4cd78756c9d7198a7

[Gerrit Updater]

"Zhenyu Xu <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51108
Subject: LU-16837 csdc: reserve connect bits for compressed layout
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: d1cdd49f6583335a5b7bb6d01e554c1b582ed983

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51108/
Subject: LU-16837 csdc: reserve connect bits for compressed layout
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 83189aef3b23f18cb8c1deae34994a00f8582039

[Gerrit Updater]

"Zhenyu Xu <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51766
Subject: LU-16837 lustre: avoid the same member name
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 23623e8712872e18f5eff634658d29e63658663a

[Andreas Dilger]

The clients should send OBD_BRW_COMPRESSED for every compressed file read RPC to indicate that they can read the compressed chunks of the file. In the future, OSTs could decompress chunks in memory for clients that do not support compression or clients using GPU Direct on a file.

The sending of OBD_BRW_COMPRESSED in read RPCs and negotiation of suppprted compression types needs to be done as part of the v1 implementation, otherwise it will make it difficult to implement "decompress on read" and compression type negotiation in the future.

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51060/
Subject: LU-16837 llite: handle unknown layout component
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 14ed4a6f8f231fe94392906f991a32f07e7d7883

[Gerrit Updater]

"Zhenyu Xu <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52826
Subject: LU-16837 lov: NULL dereference in lov_delete_composite
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 10b4a14b389cb00e1033e2f49e3d1f5a554b259a

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/52826/
Subject: LU-16837 lov: NULL dereference in lov_delete_composite
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 250c6195fbe748d7c8f4c55888ed749de4cb95ce

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51766/
Subject: LU-16837 lustre: avoid the same member name
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: a4b5304ae5542373de4ad1f2bca193dfb95ef7ff

[Peter Jones]

All seems to be merged for 2.16