[bnh65367@cs04r-sc-serv-66 ~]$ bin/get_spfs1_ost_brw_stats.sh spfs1_brw_stats_20130124133341 [bnh65367@cs04r-sc-serv-66 ~]$ for i in 1 2 4 8 ; do export NSLOTS=$i ; $MPIRUN ${MPIRUN_OPTS} -np $NSLOTS -machinefile ${TMPDIR}/hostfile /home/bnh65367/code/ior/src/ior -o ${IORTESTDIR}/ior_dat -w -k -t1m -b 20g -i 2 -e && bin/get_spfs1_ost_brw_stats.sh ; done IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 13:33:51 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t1m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 13:33:51 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 1 (1 per node) repetitions = 2 xfersize = 1 MiB blocksize = 20 GiB aggregate filesize = 20 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 450.69 20971520 1024.00 0.003350 45.44 0.000721 45.44 0 write 452.26 20971520 1024.00 0.004660 45.28 0.000661 45.28 1 Max Write: 452.26 MiB/sec (474.23 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 452.26 450.69 451.47 0.78 45.36280 0 1 1 2 0 0 1 0 0 1 21474836480 1048576 21474836480 POSIX 0 Finished: Thu Jan 24 13:35:33 2013 spfs1_brw_stats_20130124133533 IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 13:35:38 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t1m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 13:35:38 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 2 (2 per node) repetitions = 2 xfersize = 1 MiB blocksize = 20 GiB aggregate filesize = 40 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 440.25 20971520 1024.00 0.005907 93.03 0.001185 93.04 0 write 396.31 20971520 1024.00 0.005904 103.35 0.001320 103.35 1 Max Write: 440.25 MiB/sec (461.64 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 440.25 396.31 418.28 21.97 98.19564 0 2 2 2 0 0 1 0 0 1 21474836480 1048576 42949672960 POSIX 0 Finished: Thu Jan 24 13:39:30 2013 spfs1_brw_stats_20130124133930 IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 13:39:33 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t1m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 13:39:33 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 4 (4 per node) repetitions = 2 xfersize = 1 MiB blocksize = 20 GiB aggregate filesize = 80 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 309.85 20971520 1024.00 0.007921 264.39 33.01 264.39 0 write 314.82 20971520 1024.00 0.009066 260.21 22.21 260.21 1 Max Write: 314.82 MiB/sec (330.11 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 314.82 309.85 312.33 2.49 262.30185 0 4 4 2 0 0 1 0 0 1 21474836480 1048576 85899345920 POSIX 0 Finished: Thu Jan 24 13:49:16 2013 spfs1_brw_stats_20130124134916 IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 13:49:24 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t1m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 13:49:24 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 8 (8 per node) repetitions = 2 xfersize = 1 MiB blocksize = 20 GiB aggregate filesize = 160 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 295.39 20971520 1024.00 0.011881 554.66 61.91 554.66 0 write 286.24 20971520 1024.00 0.008936 572.38 76.98 572.38 1 Max Write: 295.39 MiB/sec (309.74 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 295.39 286.24 290.82 4.57 563.52100 0 8 8 2 0 0 1 0 0 1 21474836480 1048576 171798691840 POSIX 0 Finished: Thu Jan 24 14:09:33 2013 spfs1_brw_stats_20130124140933 [bnh65367@cs04r-sc-serv-66 ~]$ [bnh65367@cs04r-sc-serv-66 ~]$ for i in 1 2 4 8 ; do export NSLOTS=$i ; $MPIRUN ${MPIRUN_OPTS} -np $NSLOTS -machinefile ${TMPDIR}/hostfile /home/bnh65367/code/ior/src/ior -o ${IORTESTDIR}/ior_dat -w -k -t4m -b 20g -i 2 -e && bin/get_spfs1_ost_brw_stats.sh ; done IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 14:12:37 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t4m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 14:12:37 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 1 (1 per node) repetitions = 2 xfersize = 4 MiB blocksize = 20 GiB aggregate filesize = 20 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 466.54 20971520 4096 0.003485 43.89 0.000568 43.90 0 write 468.68 20971520 4096 0.003573 43.69 0.000681 43.70 1 Max Write: 468.68 MiB/sec (491.44 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 468.68 466.54 467.61 1.07 43.79783 0 1 1 2 0 0 1 0 0 1 21474836480 4194304 21474836480 POSIX 0 Finished: Thu Jan 24 14:14:51 2013 spfs1_brw_stats_20130124141451 IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 14:14:55 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t4m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 14:14:55 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 2 (2 per node) repetitions = 2 xfersize = 4 MiB blocksize = 20 GiB aggregate filesize = 40 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 413.03 20971520 4096 0.006139 99.16 0.001304 99.17 0 write 369.54 20971520 4096 0.005436 110.84 0.001309 110.84 1 Max Write: 413.03 MiB/sec (433.09 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 413.03 369.54 391.28 21.75 105.00571 0 2 2 2 0 0 1 0 0 1 21474836480 4194304 42949672960 POSIX 0 Finished: Thu Jan 24 14:19:02 2013 spfs1_brw_stats_20130124141902 IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 14:19:06 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t4m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 14:19:06 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 4 (4 per node) repetitions = 2 xfersize = 4 MiB blocksize = 20 GiB aggregate filesize = 80 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 320.56 20971520 4096 4.57 250.98 71.17 255.55 0 write 342.05 20971520 4096 0.008283 239.50 44.68 239.50 1 Max Write: 342.05 MiB/sec (358.66 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 342.05 320.56 331.30 10.74 247.52628 0 4 4 2 0 0 1 0 0 1 21474836480 4194304 85899345920 POSIX 0 Finished: Thu Jan 24 14:28:24 2013 spfs1_brw_stats_20130124142824 IOR-3.0.0: MPI Coordinated Test of Parallel I/O Began: Thu Jan 24 14:28:37 2013 Command line used: /home/bnh65367/code/ior/src/ior -o /mnt/lustre-test/frederik1/stripe-all//ior_dat -w -k -t4m -b 20g -i 2 -e Machine: Linux cs04r-sc-serv-66.diamond.ac.uk Test 0 started: Thu Jan 24 14:28:37 2013 Summary: api = POSIX test filename = /mnt/lustre-test/frederik1/stripe-all//ior_dat access = single-shared-file ordering in a file = sequential offsets ordering inter file= no tasks offsets clients = 8 (8 per node) repetitions = 2 xfersize = 4 MiB blocksize = 20 GiB aggregate filesize = 160 GiB access bw(MiB/s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---------- --------- -------- -------- -------- -------- ---- write 335.29 20971520 4096 0.011272 488.64 339.26 488.65 0 write 334.71 20971520 4096 0.011289 489.50 186.16 489.50 1 Max Write: 335.29 MiB/sec (351.58 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Mean(s) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize API RefNum write 335.29 334.71 335.00 0.29 489.07466 0 8 8 2 0 0 1 0 0 1 21474836480 4194304 171798691840 POSIX 0 Finished: Thu Jan 24 14:46:14 2013 spfs1_brw_stats_20130124144614 [bnh65367@cs04r-sc-serv-66 ~]$