It would be very useful to add an io500.sh test session that runs the io500 test on the current filesystem config using all of the clients configured. This test session should take about 1h to run using the default test parameters. It does need working MPI on the clients in order to run, but I think that is true of other test sessions as well (e.g. sanity-benchmark).
This would allow the benchmark to be run on a patch like:
on a patch to determine the performance impact of particular patches and to ensure that the test keeps working properly.