-----============= acceptance-small: parallel-scale ============----- Mon Jun 27 20:34:03 UTC 2016
Running: bash /scratch/lustre-tests/tests/parallel-scale.sh
excepting tests: parallel_grouplock
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients spirit-11,spirit-14,spirit-15,spirit-16,spirit-17,spirit-18,spirit-19,spirit-20,spirit-21,spirit-22,spirit-23,spirit-24,spirit-25,spirit-26,spirit-27,spirit-28 environments
Using TIMEOUT=100
disable quota as required
osd-ldiskfs.track_declares_assert=1
osd-ldiskfs.track_declares_assert=1
osd-ldiskfs.track_declares_assert=1


== parallel-scale test iorfpp: iorfpp == 20:34:27 (1467059667)
+ 4 * 1024 * 1024 * 128 
OPTIONS:
IOR=/usr/bin/IOR
ior_THREADS=8
ior_DURATION=4320
MACHINEFILE=/tmp/parallel-scale.machines
spirit-11
spirit-14
spirit-15
spirit-16
spirit-17
spirit-18
spirit-19
spirit-20
spirit-21
spirit-22
spirit-23
spirit-24
spirit-25
spirit-26
spirit-27
spirit-28
+ /usr/bin/IOR -a POSIX -b 4g -o /mnt/lustre/d0.ior.fpp/iorData          -t 2m -v -C -w -r -W -i 5 -T 4320 -k -F
000: IOR-2.10.3: MPI Coordinated Test of Parallel I/O
000: 
000: Run began: Mon Jun 27 20:34:33 2016
000: Command line used: /usr/bin/IOR -a POSIX -b 4g -o /mnt/lustre/d0.ior.fpp/iorData -t 2m -v -C -w -r -W -i 5 -T 4320 -k -F
000: Machine: Linux spirit-11.spirit.hpdd.intel.com
000: Start time skew across all tasks: 0.02 sec
000: Path: /mnt/lustre/d0.ior.fpp
000: FS: 142.9 TiB   Used FS: 0.0%   Inodes: 512.0 Mi   Used Inodes: 0.0%
000: Participating tasks: 128
000: Using reorderTasks '-C' (expecting block, not cyclic, task assignment)
000: 
000: Summary:
000: 	api                = POSIX
000: 	test filename      = /mnt/lustre/d0.ior.fpp/iorData
000: 	access             = file-per-process
000: 	pattern            = segmented (1 segment)
000: 	ordering in a file = sequential offsets
000: 	ordering inter file=constant task offsets = 1
000: 	clients            = 128 (8 per node)
000: 	repetitions        = 5
000: 	xfersize           = 2 MiB
000: 	blocksize          = 4 GiB
000: 	aggregate filesize = 512 GiB
000: 
000: Commencing write performance test.
000: Mon Jun 27 20:34:33 2016
000: 
000: Verifying contents of the file(s) just written.
000: Mon Jun 27 20:37:23 2016
000: 
000: Commencing read performance test.
000: Mon Jun 27 20:40:41 2016
000: 
000: Commencing write performance test.
000: Mon Jun 27 20:43:40 2016
000: 
000: Verifying contents of the file(s) just written.
000: Mon Jun 27 20:46:30 2016
000: 
000: Commencing read performance test.
000: Mon Jun 27 20:49:49 2016
000: 
000: Commencing write performance test.
000: Mon Jun 27 20:52:49 2016
000: 
000: Verifying contents of the file(s) just written.
000: Mon Jun 27 20:55:41 2016
000: 
000: Commencing read performance test.
000: Mon Jun 27 20:59:01 2016
000: 
000: Commencing write performance test.
000: Mon Jun 27 21:02:02 2016
000: 
000: Verifying contents of the file(s) just written.
000: Mon Jun 27 21:04:52 2016
000: 
000: Commencing read performance test.
000: Mon Jun 27 21:08:17 2016
000: 
000: Commencing write performance test.
000: Mon Jun 27 21:11:27 2016
000: 
000: Verifying contents of the file(s) just written.
000: Mon Jun 27 21:14:18 2016
000: 
000: Commencing read performance test.
000: Mon Jun 27 21:17:32 2016
000: 
000: Operation  Max (MiB)  Min (MiB)  Mean (MiB)   Std Dev  Max (OPs)  Min (OPs)  Mean (OPs)   Std Dev  Mean (s)  Op grep #Tasks tPN reps  fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
000: 
000: ---------  ---------  ---------  ----------   -------  ---------  ---------  ----------   -------  --------
000: write        3093.30    3047.69     3078.84     16.87    1546.65    1523.85     1539.42      8.43 170.29250   128 8 5 1 1 1 0 0 1 4294967296 2097152 549755813888 -1 POSIX EXCEL
000: read         2928.37    2762.09     2881.75     61.70    1464.19    1381.04     1440.87     30.85 182.01990   128 8 5 1 1 1 0 0 1 4294967296 2097152 549755813888 -1 POSIX EXCEL
000: 
000: Max Write: 3093.30 MiB/sec (3243.56 MB/sec)
000: Max Read:  2928.37 MiB/sec (3070.62 MB/sec)
000: 
000: Run finished: Mon Jun 27 21:20:32 2016
Resetting fail_loc on all nodes...done.
PASS iorfpp (2770s)
== parallel-scale test complete, duration 2793 sec == 21:20:38 (1467062438)
