[LU-6708] osd-zfs: multiple OSTs in a same zpool breaks grants

Wed, 10 Jun 2015 21:34:00 +0000

As Johann just explained to me: the OSS grants clients certain space due to client side write caching, to guarantee space would be available when the cache is flushed. With multiple OSTs in a same zpool, the free space of the pool is reported as available to all OSTs. Then the OSTs would believe they each have available the free space of the pool, while they actually share that space. Therefore grants would be broken when multiple OSTs reside in a same zpool.

If there's no use case for multiple OSTs in a same zpool, we should improve our documents to point out that it's not supported. Otherwise, we'd modify osd-zfs to make use of space reservation mechanisms to guarantee grant space availability when multiple OSTs share a same pool:
http://docs.oracle.com/cd/E19253-01/819-5461/gazvb/index.html

For example: zfs set reservation=10G pool/ost1

Whamcloud Community JIRA

[LU-6708] osd-zfs: multiple OSTs in a same zpool breaks grants