Created /scratch/auster-base/test_logs/2016-06-27/ddn16thr/16/iorfpp/005609/shared_directory.139535
Started at Tue Jun 28 00:56:11 UTC 2016
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients spirit-11,spirit-14,spirit-15,spirit-16,spirit-17,spirit-18,spirit-19,spirit-20,spirit-21,spirit-22,spirit-23,spirit-24,spirit-25,spirit-26,spirit-27,spirit-28 environments
Logging to shared log directory: /scratch/auster-base/test_logs/2016-06-27/ddn16thr/16/iorfpp/005609
running: parallel-scale ONLY=iorfpp 
run_suite parallel-scale /scratch/lustre-tests/tests/parallel-scale.sh
-----============= acceptance-small: parallel-scale ============----- Tue Jun 28 00:56:33 UTC 2016
Running: bash /scratch/lustre-tests/tests/parallel-scale.sh
excepting tests: parallel_grouplock
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients spirit-11,spirit-14,spirit-15,spirit-16,spirit-17,spirit-18,spirit-19,spirit-20,spirit-21,spirit-22,spirit-23,spirit-24,spirit-25,spirit-26,spirit-27,spirit-28 environments
Using TIMEOUT=100
disable quota as required
osd-ldiskfs.track_declares_assert=1
osd-ldiskfs.track_declares_assert=1
osd-ldiskfs.track_declares_assert=1


== parallel-scale test iorfpp: iorfpp == 00:56:56 (1467075416)
+ 4 * 1024 * 1024 * 256 
OPTIONS:
IOR=/usr/bin/IOR
ior_THREADS=16
ior_DURATION=4320
MACHINEFILE=/tmp/parallel-scale.machines
spirit-11
spirit-14
spirit-15
spirit-16
spirit-17
spirit-18
spirit-19
spirit-20
spirit-21
spirit-22
spirit-23
spirit-24
spirit-25
spirit-26
spirit-27
spirit-28
+ /usr/bin/IOR -a POSIX -b 4g -o /mnt/lustre/d0.ior.fpp/iorData          -t 2m -v -C -w -r -W -i 5 -T 4320 -k -F
000: IOR-2.10.3: MPI Coordinated Test of Parallel I/O
000: 
000: Run began: Tue Jun 28 00:57:03 2016
000: Command line used: /usr/bin/IOR -a POSIX -b 4g -o /mnt/lustre/d0.ior.fpp/iorData -t 2m -v -C -w -r -W -i 5 -T 4320 -k -F
000: Machine: Linux spirit-11.spirit.hpdd.intel.com
000: Start time skew across all tasks: 0.02 sec
000: Path: /mnt/lustre/d0.ior.fpp
000: FS: 142.9 TiB   Used FS: 0.0%   Inodes: 512.0 Mi   Used Inodes: 0.0%
000: Participating tasks: 256
000: Using reorderTasks '-C' (expecting block, not cyclic, task assignment)
000: 
000: Summary:
000: 	api                = POSIX
000: 	test filename      = /mnt/lustre/d0.ior.fpp/iorData
000: 	access             = file-per-process
000: 	pattern            = segmented (1 segment)
000: 	ordering in a file = sequential offsets
000: 	ordering inter file=constant task offsets = 1
000: 	clients            = 256 (16 per node)
000: 	repetitions        = 5
000: 	xfersize           = 2 MiB
000: 	blocksize          = 4 GiB
000: 	aggregate filesize = 1024 GiB
000: 
000: Commencing write performance test.
000: Tue Jun 28 00:57:03 2016
000: 
000: Verifying contents of the file(s) just written.
000: Tue Jun 28 01:04:28 2016
000: 
000: Commencing read performance test.
000: Tue Jun 28 01:11:47 2016
000: 
000: Commencing write performance test.
000: Tue Jun 28 01:19:03 2016
000: 
000: Verifying contents of the file(s) just written.
000: Tue Jun 28 01:26:18 2016
000: 
000: Commencing read performance test.
000: Tue Jun 28 01:34:02 2016
000: 
000: Commencing write performance test.
000: Tue Jun 28 01:41:31 2016
000: 
000: Verifying contents of the file(s) just written.
000: Tue Jun 28 01:48:37 2016
000: 
000: Commencing read performance test.
000: Tue Jun 28 01:56:08 2016
000: 
000: Commencing write performance test.
000: Tue Jun 28 02:03:23 2016
000: 
000: Verifying contents of the file(s) just written.
000: Tue Jun 28 02:10:21 2016
000: 
000: Commencing read performance test.
000: Tue Jun 28 02:17:57 2016
000: 
000: Commencing write performance test.
000: Tue Jun 28 02:25:13 2016
000: 
000: Verifying contents of the file(s) just written.
000: Tue Jun 28 02:32:15 2016
000: 
000: Commencing read performance test.
000: Tue Jun 28 02:40:01 2016
000: 
000: Operation  Max (MiB)  Min (MiB)  Mean (MiB)   Std Dev  Max (OPs)  Min (OPs)  Mean (OPs)   Std Dev  Mean (s)  Op grep #Tasks tPN reps  fPP reord reordoff reordrand seed segcnt blksiz xsize aggsize
000: 
000: ---------  ---------  ---------  ----------   -------  ---------  ---------  ----------   -------  --------
000: write        2505.01    2357.03     2442.99     53.12    1252.51    1178.51     1221.50     26.56 429.42352   256 16 5 1 1 1 0 0 1 4294967296 2097152 1099511627776 -1 POSIX EXCEL
000: read         2414.01    2334.22     2381.34     33.01    1207.01    1167.11     1190.67     16.50 440.41501   256 16 5 1 1 1 0 0 1 4294967296 2097152 1099511627776 -1 POSIX EXCEL
000: 
000: Max Write: 2505.01 MiB/sec (2626.70 MB/sec)
000: Max Read:  2414.01 MiB/sec (2531.27 MB/sec)
000: 
000: Run finished: Tue Jun 28 02:47:28 2016
Resetting fail_loc on all nodes...done.
PASS iorfpp (6638s)
== parallel-scale test complete, duration 6658 sec == 02:47:34 (1467082054)
parallel-scale returned 0
Finished at Tue Jun 28 02:47:37 UTC 2016 in 6686s
./auster: completed with rc 0
Done auster
