[LU-8123] MDT zpool capacity being consumed at a faster rate than expected

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.7.0, Lustre 2.8.0, Lustre 2.9.0
• Type: Bug
• Priority: Minor
• Reporter: Andreas Dilger
• Assignee: Andreas Dilger
• Resolution: Duplicate

Environment

ZFS MDT ashift=12 recordsize=4096

• Severity: 3

Description

When running mdtest to create zero byte files on a new LFS to benchmark the MDS I noticed that in creating 600K zero byte files I only used a small percentage of Lustre inodes but the MDT zpool capacity was 65% used. The ratio of inodes used to capacity used not only seems way off but it appears on track to run out of zpool space before Lustre thinks it's out of inodes. I know another large site is seeing similar on a production LFS.

In my case the MDT is a five-plex mirror vdev made in the following way:

zpool create -o ashift=12 -O recordsize=4096 mdt.pool mirror A1 A2 mirror A3 A4 mirror A5 A6 mirror A7 A8 mirror A9 A10

I have also seen the behavior using default recordsize.

Maybe I'm overlooking something but it seems the capacity consumption is overtaking inode allocation. This could be something in the way ZFS reports capacity used when Lustre is hooking in at a level below ZFS layer but from the cockpit it looks like my MDT tops out while Lustre thinks there are inodes available.

Issue Links

• is related to: LU-8124 MDT zpool capacity consumed at greate...

Comments

[Alex Zhuravlev]

any numbers?

[Alex Zhuravlev]

you can check with zdb how many bytes are spent on every dnode?

[Andreas Dilger]

Duplicate of LU-8124.