Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-16837

interop: client skip unknown component mirror

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • Lustre 2.16.0
    • None
    • 3
    • 9223372036854775807

    Description

      If the client encounters unknown components in a FLR file, it should skip the mirror to choose another known mirror for read/write.

      This provides some forward compatibility for clients accessing mirrored files - they can always read files that have at least one "known" mirror, even if there are other "unknown" mirrors (e.g. compressed, EC, PCC/HSM with some unknown type, etc.).

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. LU-10026 Client-side data compression

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LU-10606 HSM info as part of LOV layout xattr

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. LU-10911 FLR2: Erasure coding

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • In Progress

          Activity

            [LU-16837] interop: client skip unknown component mirror
            pjones Peter Jones added a comment -

            All seems to be merged for 2.16

            pjones Peter Jones added a comment - All seems to be merged for 2.16
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51766/
            Subject: LU-16837 lustre: avoid the same member name
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: a4b5304ae5542373de4ad1f2bca193dfb95ef7ff

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51766/ Subject: LU-16837 lustre: avoid the same member name Project: fs/lustre-release Branch: master Current Patch Set: Commit: a4b5304ae5542373de4ad1f2bca193dfb95ef7ff
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/52826/
            Subject: LU-16837 lov: NULL dereference in lov_delete_composite
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 250c6195fbe748d7c8f4c55888ed749de4cb95ce

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/52826/ Subject: LU-16837 lov: NULL dereference in lov_delete_composite Project: fs/lustre-release Branch: master Current Patch Set: Commit: 250c6195fbe748d7c8f4c55888ed749de4cb95ce
            gerrit Gerrit Updater added a comment -

            "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52826
            Subject: LU-16837 lov: NULL dereference in lov_delete_composite
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 10b4a14b389cb00e1033e2f49e3d1f5a554b259a

            gerrit Gerrit Updater added a comment - "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/52826 Subject: LU-16837 lov: NULL dereference in lov_delete_composite Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 10b4a14b389cb00e1033e2f49e3d1f5a554b259a
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51060/
            Subject: LU-16837 llite: handle unknown layout component
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 14ed4a6f8f231fe94392906f991a32f07e7d7883

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51060/ Subject: LU-16837 llite: handle unknown layout component Project: fs/lustre-release Branch: master Current Patch Set: Commit: 14ed4a6f8f231fe94392906f991a32f07e7d7883
            adilger Andreas Dilger added a comment -

            The clients should send OBD_BRW_COMPRESSED for every compressed file read RPC to indicate that they can read the compressed chunks of the file. In the future, OSTs could decompress chunks in memory for clients that do not support compression or clients using GPU Direct on a file.

            The sending of OBD_BRW_COMPRESSED in read RPCs and negotiation of suppprted compression types needs to be done as part of the v1 implementation, otherwise it will make it difficult to implement "decompress on read" and compression type negotiation in the future.

            adilger Andreas Dilger added a comment - The clients should send OBD_BRW_COMPRESSED for every compressed file read RPC to indicate that they can read the compressed chunks of the file. In the future, OSTs could decompress chunks in memory for clients that do not support compression or clients using GPU Direct on a file. The sending of OBD_BRW_COMPRESSED in read RPCs and negotiation of suppprted compression types needs to be done as part of the v1 implementation, otherwise it will make it difficult to implement "decompress on read" and compression type negotiation in the future.
            gerrit Gerrit Updater added a comment -

            "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51766
            Subject: LU-16837 lustre: avoid the same member name
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 23623e8712872e18f5eff634658d29e63658663a

            gerrit Gerrit Updater added a comment - "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51766 Subject: LU-16837 lustre: avoid the same member name Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 23623e8712872e18f5eff634658d29e63658663a
            gerrit Gerrit Updater added a comment -

            "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51108/
            Subject: LU-16837 csdc: reserve connect bits for compressed layout
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 83189aef3b23f18cb8c1deae34994a00f8582039

            gerrit Gerrit Updater added a comment - "Oleg Drokin <green@whamcloud.com>" merged in patch https://review.whamcloud.com/c/fs/lustre-release/+/51108/ Subject: LU-16837 csdc: reserve connect bits for compressed layout Project: fs/lustre-release Branch: master Current Patch Set: Commit: 83189aef3b23f18cb8c1deae34994a00f8582039
            gerrit Gerrit Updater added a comment -

            "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51108
            Subject: LU-16837 csdc: reserve connect bits for compressed layout
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: d1cdd49f6583335a5b7bb6d01e554c1b582ed983

            gerrit Gerrit Updater added a comment - "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51108 Subject: LU-16837 csdc: reserve connect bits for compressed layout Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: d1cdd49f6583335a5b7bb6d01e554c1b582ed983
            gerrit Gerrit Updater added a comment -

            "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51060
            Subject: LU-16837 llite: handle unknown layout component
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: c93adde0919f9afcf8bc98a4cd78756c9d7198a7

            gerrit Gerrit Updater added a comment - "Zhenyu Xu <bobijam@hotmail.com>" uploaded a new patch: https://review.whamcloud.com/c/fs/lustre-release/+/51060 Subject: LU-16837 llite: handle unknown layout component Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: c93adde0919f9afcf8bc98a4cd78756c9d7198a7

            People

              bobijam Zhenyu Xu
              bobijam Zhenyu Xu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: