Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-4865

osd-zfs: increase object block size dynamically as object grows

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.9.0
    • None
    • 13423

    Description

      The ZFS VFS code does change blocksize as file grows, e.g. in zfs_write()->zfs_grow_blocksize(). But the osd-zfs just opens the objset and manipulate it directly by the DMU API, shortcutting ZFS VFS layers, so the zfs_grow_blocksize() logic will not work for us.

      Currently the osd-zfs set blocksize to 0 on MDS (then ZFS converts it to the default 512 byte block size), and to 128K on OSS. Neither is optimal setting. We may need to duplicate the ZPL functionality to grow block size dynamically as well.

      Attachments

        Issue Links

          Activity

            [LU-4865] osd-zfs: increase object block size dynamically as object grows
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-15963 [ LU-15963 ]
            adilger Andreas Dilger made changes -
            Link Original: This issue is related to LU-4931 [ LU-4931 ]
            adilger Andreas Dilger made changes -
            Link Original: This issue is related to LU-7225 [ LU-7225 ]
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LU-8591 [ LU-8591 ]
            jgmitter Joseph Gmitter (Inactive) made changes -
            Fix Version/s New: Lustre 2.9.0 [ 11891 ]
            Fix Version/s Original: Lustre 2.10.0 [ 12204 ]
            Resolution New: Fixed [ 1 ]
            Status Original: Reopened [ 4 ] New: Resolved [ 5 ]

            Landed to master for 2.9.0

            jgmitter Joseph Gmitter (Inactive) added a comment - Landed to master for 2.9.0

            Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18441/
            Subject: LU-4865 zfs: grow block size by write pattern
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: b738c4850935f3a9c483b3141cb37d6539557615

            gerrit Gerrit Updater added a comment - Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/18441/ Subject: LU-4865 zfs: grow block size by write pattern Project: fs/lustre-release Branch: master Current Patch Set: Commit: b738c4850935f3a9c483b3141cb37d6539557615
            pjones Peter Jones made changes -
            Fix Version/s New: Lustre 2.10.0 [ 12204 ]
            Fix Version/s Original: Lustre 2.9.0 [ 11891 ]

            Jinshan Xiong (jinshan.xiong@intel.com) uploaded a new patch: http://review.whamcloud.com/18441
            Subject: LU-4865 zfs: grow block size by write pattern
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: c2f3cb1cd31bb69b5ca08a56485e4fa4d7e03d7d

            gerrit Gerrit Updater added a comment - Jinshan Xiong (jinshan.xiong@intel.com) uploaded a new patch: http://review.whamcloud.com/18441 Subject: LU-4865 zfs: grow block size by write pattern Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: c2f3cb1cd31bb69b5ca08a56485e4fa4d7e03d7d
            adilger Andreas Dilger made changes -
            Link New: This issue is related to LDEV-177 [ LDEV-177 ]

            People

              jay Jinshan Xiong (Inactive)
              isaac Isaac Huang (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: