[LU-12158] Don't have large stripe_width and stride to prevent unexpected performance regression

• Type: Bug
• Resolution: Fixed
• Priority: Minor
• Environment: master
• Severity: 3
• Assignee: Wang Shilong (Inactive)
• Reporter: Shuichi Ihara

Description

stripe width and stride was calculated based on optimal_io_size that kernel got from backend storage devices. If storage controller returns large optimal io size (e.g. 16MB) to kernel, stripe_width and stride are are large value (e.g. optimal_io_size/blcok size) at mkfs.

[root@es18k-vm1 ~]# dumpe2fs -h /dev/sda  | grep RAID
dumpe2fs 1.44.3.wc1 (23-July-2018)
RAID stride:              4096
RAID stripe width:        4096
[root@es18k-vm1 ~]# dumpe2fs -h /dev/sdi  | grep RAID
dumpe2fs 1.44.3.wc1 (23-July-2018)
RAID stride:              512
RAID stripe width:        512

[root@es18k-vm1 ~]# cat /sys/block/sda/queue/optimal_io_size 
16777216
[root@es18k-vm1 ~]# cat /sys/block/sdi/queue/optimal_io_size 
2097152

However, such large stripe_width and stride size causes performance regression. because ext4 takes more costs to find stripe_width-sized free chunks.

	2MB Chunk size		256K Chunk size
	Write(MB/s)	Read(MB/s)	Write(MB/s)	Read(MB/s)
stripe_width=512,stride=512	10,810	10,124	10,492	6,923
stripe_width=1024,stride=1024	10,793	10,064	10,431	6,921
stripe_width=2048,stride=2048	8,047	10,080	6,629	7,381
stripe_width=4096,stride=4096	7,350	10,089	6,505	7,282

Also, stripe_width and stride are tunable (e.g. -E stripe_width= 4096,stride=4096) option to mkfs.  If administrator formats OSTs with wrong stripe_width and stride, it may cause unexpected performance regressions.

mkfs.lustre should avoid such large stripe_width/stride and prints a warning message if it's trying to configure.

Comments

[Peter Jones]

Looks like this is fixed and just needs a new e2fsprogs release so it is available

[Gerrit Updater]

Andreas Dilger ([e-mail]) merged in patch https://review.whamcloud.com/34767/
Subject: LU-12158 mke2fs: avoid too large stride and stripe_width
Project: tools/e2fsprogs
Branch: master-lustre
Current Patch Set:
Commit: 045ec3ce0f16d35f2ee90f9c3adba3471dbfd625

[Gerrit Updater]

Wang Shilong ([e-mail]) uploaded a new patch: https://review.whamcloud.com/34767
Subject: LU-12158 mke2fs: avoid too large stride and stripe_width
Project: tools/e2fsprogs
Branch: master-lustre
Current Patch Set: 1
Commit: 07b62f26bed99602f492b2b6ff1c932fbb3048c7