starting tests:Mon May 23 22:02:56 UTC 2022
os release:
Linux a100-01 5.4.0-109-generic #123-Ubuntu SMP Fri Apr 8 09:10:54 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
nvidia-smi:
Mon May 23 22:02:56 2022       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.43.04    Driver Version: 515.43.04    CUDA Version: 11.7     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A100-SXM...  On   | 00000000:07:00.0 Off |                    0 |
| N/A   28C    P0    59W / 400W |      0MiB / 40960MiB |      7%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A100-SXM...  On   | 00000000:0F:00.0 Off |                    0 |
| N/A   27C    P0    54W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA A100-SXM...  On   | 00000000:47:00.0 Off |                    0 |
| N/A   27C    P0    53W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   3  NVIDIA A100-SXM...  On   | 00000000:4E:00.0 Off |                    0 |
| N/A   27C    P0    52W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   4  NVIDIA A100-SXM...  On   | 00000000:87:00.0 Off |                    0 |
| N/A   32C    P0    54W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   5  NVIDIA A100-SXM...  On   | 00000000:90:00.0 Off |                    0 |
| N/A   32C    P0    58W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   6  NVIDIA A100-SXM...  On   | 00000000:B7:00.0 Off |                    0 |
| N/A   32C    P0    55W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   7  NVIDIA A100-SXM...  On   | 00000000:BD:00.0 Off |                    0 |
| N/A   32C    P0    54W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
using path /data/sanity SPARSE_FILES = true CREATE_FILES = true BIG BARSIZE = false 
nvidia_fs             245760  0
Begin nvidia-fs:
GDS Version: 1.3.0.44 
NVFS statistics(ver: 4.0)
NVFS Driver(version: 2.12.4)
Mellanox PeerDirect Supported: True
IO stats: Disabled, peer IO stats: Disabled
Logging level: info

Active Shadow-Buffer (MiB): 0
Active Process: 0
Reads				: err=0 io_state_err=0
Sparse Reads		        : n=16136 io=0 holes=14 pages=14 
Writes				: err=6 io_state_err=0 pg-cache=1813 pg-cache-fail=0 pg-cache-eio=6
Mmap				: n=2100 ok=2100 err=0 munmap=2100
Bar1-map			: n=2100 ok=2100 err=0 free=1920 callbacks=180 active=0
Error				: cpu-gpu-pages=0 sg-ext=0 dma-map=0 dma-ref=0
Ops				: Read=0 Write=0 BatchIO=0
GPU 0000:4e:00.0  uuid:b6f94773-211d-429a-dbdf-6823df80ba88 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=44 
GPU 0000:bd:00.0  uuid:599a30af-eed5-cfba-6746-8d5bd2c30133 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:b7:00.0  uuid:85ab4c50-7c74-1fdd-8e8d-3b55328533a1 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:87:00.0  uuid:3ad4d79b-90cc-00bd-d3d5-adf5084844e3 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:90:00.0  uuid:7d3cdaf1-7dae-30cd-f888-7319ef2abbb1 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:47:00.0  uuid:63bf04f1-2e24-73ea-76a9-bb8bde9cdfc9 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=44 
GPU 0000:07:00.0  uuid:30f846a7-21d0-057e-15b6-472ba0e5ab17 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=210 
GPU 0000:0f:00.0  uuid:e8992b2c-1ea8-319d-6015-1d507015760c : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=36 
loading nvidia_peermem
nvidia_peermem         16384  0
ib_core               348160  10 rdma_cm,ib_ipoib,ko2iblnd,nvidia_peermem,iw_cm,ib_umad,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm
nvidia              39620608  437 nvidia_uvm,nvidia_peermem,nvidia_modeset
creating sparse files
gdscheck.py tests
gdscheck.py python3 tests
=========================
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64
 ============
 ENVIRONMENT:
 ============
 =====================
 DRIVER CONFIGURATION:
 =====================
 NVMe               : Unsupported
 NVMeOF             : Unsupported
 SCSI               : Unsupported
 ScaleFlux CSD      : Unsupported
 NVMesh             : Unsupported
 DDN EXAScaler      : Supported
 IBM Spectrum Scale : Unsupported
 NFS                : Unsupported
 BeeGFS             : Unsupported
 WekaFS             : Unsupported
 Userspace RDMA     : Unsupported
 --Mellanox PeerDirect : Enabled
 --rdma library        : Not Loaded (libcufile_rdma.so)
 --rdma devices        : Not configured
 --rdma_device_status  : Up: 0 Down: 0
 =====================
 CUFILE CONFIGURATION:
 =====================
 properties.use_compat_mode : false
 properties.force_compat_mode : false
 properties.gds_rdma_write_support : true
 properties.use_poll_mode : false
 properties.poll_mode_max_size_kb : 4
 properties.max_batch_io_size : 128
 properties.max_batch_io_timeout_msecs : 5
 properties.max_direct_io_size_kb : 16384
 properties.max_device_cache_size_kb : 131072
 properties.max_device_pinned_mem_size_kb : 33554432
 properties.posix_pool_slab_size_kb : 4 1024 16384 
 properties.posix_pool_slab_count : 128 64 32 
 properties.rdma_peer_affinity_policy : RoundRobin
 properties.rdma_dynamic_routing : 0
 fs.generic.posix_unaligned_writes : false
 fs.lustre.posix_gds_min_kb: 0
 fs.beegfs.posix_gds_min_kb: 0
 fs.weka.rdma_write_support: false
 profile.nvtx : false
 profile.cufile_stats : 0
 miscellaneous.api_check_aggressive : false
 =========
 GPU INFO:
 =========
 GPU index 0 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 1 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 2 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 3 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 4 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 5 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 6 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 7 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 ==============
 PLATFORM INFO:
 ==============
 IOMMU: disabled
 Platform verification succeeded

SUCCESS
FILESYSTEM VERSION CHECK:
ofed_info:
current version: MLNX_OFED_LINUX-5.6-1.0.3.3: (Supported)
min version supported: MLNX_OFED_LINUX-4.6-1.0.1.1
SUCCESS
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64

SUCCESS
usage: gdscheck.py [-h] [-p] [-f FILE] [-v] [-V]

GPUDirectStorage platform checker

optional arguments:
  -h, --help  show this help message and exit
  -p          gds platform check
  -f FILE     gds file check
  -v          gds version checks
  -V          gds fs checks
SUCCESS
gdscheck.py python2 tests
=========================
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64
 ============
 ENVIRONMENT:
 ============
 =====================
 DRIVER CONFIGURATION:
 =====================
 NVMe               : Unsupported
 NVMeOF             : Unsupported
 SCSI               : Unsupported
 ScaleFlux CSD      : Unsupported
 NVMesh             : Unsupported
 DDN EXAScaler      : Supported
 IBM Spectrum Scale : Unsupported
 NFS                : Unsupported
 BeeGFS             : Unsupported
 WekaFS             : Unsupported
 Userspace RDMA     : Unsupported
 --Mellanox PeerDirect : Enabled
 --rdma library        : Not Loaded (libcufile_rdma.so)
 --rdma devices        : Not configured
 --rdma_device_status  : Up: 0 Down: 0
 =====================
 CUFILE CONFIGURATION:
 =====================
 properties.use_compat_mode : false
 properties.force_compat_mode : false
 properties.gds_rdma_write_support : true
 properties.use_poll_mode : false
 properties.poll_mode_max_size_kb : 4
 properties.max_batch_io_size : 128
 properties.max_batch_io_timeout_msecs : 5
 properties.max_direct_io_size_kb : 16384
 properties.max_device_cache_size_kb : 131072
 properties.max_device_pinned_mem_size_kb : 33554432
 properties.posix_pool_slab_size_kb : 4 1024 16384 
 properties.posix_pool_slab_count : 128 64 32 
 properties.rdma_peer_affinity_policy : RoundRobin
 properties.rdma_dynamic_routing : 0
 fs.generic.posix_unaligned_writes : false
 fs.lustre.posix_gds_min_kb: 0
 fs.beegfs.posix_gds_min_kb: 0
 fs.weka.rdma_write_support: false
 profile.nvtx : false
 profile.cufile_stats : 0
 miscellaneous.api_check_aggressive : false
 =========
 GPU INFO:
 =========
 GPU index 0 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 1 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 2 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 3 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 4 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 5 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 6 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 7 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 ==============
 PLATFORM INFO:
 ==============
 IOMMU: disabled
 Platform verification succeeded

SUCCESS
FILESYSTEM VERSION CHECK:
ofed_info:
current version: MLNX_OFED_LINUX-5.6-1.0.3.3: (Supported)
min version supported: MLNX_OFED_LINUX-4.6-1.0.1.1
SUCCESS
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64

SUCCESS
usage: gdscheck.py [-h] [-p] [-f FILE] [-v] [-V]

GPUDirectStorage platform checker

optional arguments:
  -h, --help  show this help message and exit
  -p          gds platform check
  -f FILE     gds file check
  -v          gds version checks
  -V          gds fs checks
SUCCESS
gdscheck.py current running python tests
=========================
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64
 ============
 ENVIRONMENT:
 ============
 =====================
 DRIVER CONFIGURATION:
 =====================
 NVMe               : Unsupported
 NVMeOF             : Unsupported
 SCSI               : Unsupported
 ScaleFlux CSD      : Unsupported
 NVMesh             : Unsupported
 DDN EXAScaler      : Supported
 IBM Spectrum Scale : Unsupported
 NFS                : Unsupported
 BeeGFS             : Unsupported
 WekaFS             : Unsupported
 Userspace RDMA     : Unsupported
 --Mellanox PeerDirect : Enabled
 --rdma library        : Not Loaded (libcufile_rdma.so)
 --rdma devices        : Not configured
 --rdma_device_status  : Up: 0 Down: 0
 =====================
 CUFILE CONFIGURATION:
 =====================
 properties.use_compat_mode : false
 properties.force_compat_mode : false
 properties.gds_rdma_write_support : true
 properties.use_poll_mode : false
 properties.poll_mode_max_size_kb : 4
 properties.max_batch_io_size : 128
 properties.max_batch_io_timeout_msecs : 5
 properties.max_direct_io_size_kb : 16384
 properties.max_device_cache_size_kb : 131072
 properties.max_device_pinned_mem_size_kb : 33554432
 properties.posix_pool_slab_size_kb : 4 1024 16384 
 properties.posix_pool_slab_count : 128 64 32 
 properties.rdma_peer_affinity_policy : RoundRobin
 properties.rdma_dynamic_routing : 0
 fs.generic.posix_unaligned_writes : false
 fs.lustre.posix_gds_min_kb: 0
 fs.beegfs.posix_gds_min_kb: 0
 fs.weka.rdma_write_support: false
 profile.nvtx : false
 profile.cufile_stats : 0
 miscellaneous.api_check_aggressive : false
 =========
 GPU INFO:
 =========
 GPU index 0 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 1 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 2 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 3 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 4 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 5 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 6 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 7 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 ==============
 PLATFORM INFO:
 ==============
 IOMMU: disabled
 Platform verification succeeded

SUCCESS
FILESYSTEM VERSION CHECK:
ofed_info:
current version: MLNX_OFED_LINUX-5.6-1.0.3.3: (Supported)
min version supported: MLNX_OFED_LINUX-4.6-1.0.1.1
SUCCESS
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64

SUCCESS
usage: gdscheck.py [-h] [-p] [-f FILE] [-v] [-V]

GPUDirectStorage platform checker

optional arguments:
  -h, --help  show this help message and exit
  -p          gds platform check
  -f FILE     gds file check
  -v          gds version checks
  -V          gds fs checks
SUCCESS
**************************************************
gdscheck.py test results : 12 /  12 tests passed
**************************************************
Starting basic gdsio Tests
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 4k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 252/256(KiB) IOSize: 4(KiB) Throughput: 0.008462 GiB/sec, Avg_Latency: 205.782258 usecs ops: 63 total_time 0.028400 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 3k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 243/256(KiB) IOSize: 3(KiB) Throughput: 0.021632 GiB/sec, Avg_Latency: 232.728938 usecs ops: 81 total_time 0.010713 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 3k -o 1
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 243/256(KiB) IOSize: 3(KiB) Throughput: 0.013048 GiB/sec, Avg_Latency: 409.834756 usecs ops: 81 total_time 0.017761 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 2k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 248/256(KiB) IOSize: 2(KiB) Throughput: 0.015641 GiB/sec, Avg_Latency: 222.129687 usecs ops: 124 total_time 0.015121 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 2k -o 1
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 246/256(KiB) IOSize: 2(KiB) Throughput: 0.009177 GiB/sec, Avg_Latency: 391.258329 usecs ops: 123 total_time 0.025565 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 1k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 252/256(KiB) IOSize: 1(KiB) Throughput: 0.008163 GiB/sec, Avg_Latency: 224.083417 usecs ops: 252 total_time 0.029442 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//sparse1G -d 0 -f /data/sanity/tests//sparse1G -d 0 -s 128K -i 1k -o 1
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 247/256(KiB) IOSize: 1(KiB) Throughput: 0.004825 GiB/sec, Avg_Latency: 385.214234 usecs ops: 247 total_time 0.048820 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 1 -o 1
IoType: WRITE XferType: GPUD Threads: 8 DataSetSize: 895351/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 0.583801 GiB/sec, Avg_Latency: 3305.407685 usecs ops: 3537 total_time 1.462609 secs
Verifying data 
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1026813/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 4.117711 GiB/sec, Avg_Latency: 491.438710 usecs ops: 3809 total_time 0.237813 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 3 -k 1234 -o 1
IoType: RANDWRITE XferType: GPUD Threads: 8 DataSetSize: 1015215/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 1.061564 GiB/sec, Avg_Latency: 3861.628623 usecs ops: 1878 total_time 0.912036 secs
Verifying data 
IoType: RANDREAD XferType: GPUD Threads: 8 DataSetSize: 1037020/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 6.247816 GiB/sec, Avg_Latency: 641.730877 usecs ops: 1921 total_time 0.158292 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -D /data/sanity/tests// -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 1 -o 1
Error: IO failed stopping traffic, fd :52 ret:-5 errno :1
Error: IO failed stopping traffic, fd :56 ret:-5 errno :1
Error: IO failed stopping traffic, fd :55 ret:-5 errno :1
FAILED
/usr/local/gds/tools/gdsio -V -D /data/sanity/tests// -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 3 -k 1234 -o 1
IoType: RANDWRITE XferType: GPUD Threads: 8 DataSetSize: 8243025/8388608(KiB) IOSize: 32-1024-1(KiB) Throughput: 1.556877 GiB/sec, Avg_Latency: 2543.205564 usecs ops: 15873 total_time 5.049314 secs
Verifying data 
IoType: RANDREAD XferType: GPUD Threads: 8 DataSetSize: 8176002/8388608(KiB) IOSize: 32-1024-1(KiB) Throughput: 6.631826 GiB/sec, Avg_Latency: 596.151092 usecs ops: 15736 total_time 1.175731 secs
SUCCESS
/usr/local/gds/tools/gdsio -D /data/sanity/tests// -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 3 -k 1234 -o 1 -F -R
Error: IO failed stopping traffic, fd :55 ret:-5 errno :1
FAILED
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 1 -o 1 -b
IoType: WRITE XferType: GPUD Threads: 8 DataSetSize: 912176/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 0.573804 GiB/sec, Avg_Latency: 3385.075233 usecs ops: 3574 total_time 1.516055 secs
Verifying data 
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1021251/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 3.941086 GiB/sec, Avg_Latency: 512.383096 usecs ops: 3798 total_time 0.247125 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 8M:32M -x 0 -I 1 -o 1 -b
IoType: WRITE XferType: GPUD Threads: 8 DataSetSize: 737280/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 3.691701 GiB/sec, Avg_Latency: 34584.095833 usecs ops: 41 total_time 0.190461 secs
Verifying data 
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 737280/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 7.933799 GiB/sec, Avg_Latency: 16124.941667 usecs ops: 41 total_time 0.088624 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 0 -o 1 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1023759/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 3.877459 GiB/sec, Avg_Latency: 522.230146 usecs ops: 3803 total_time 0.251797 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 8M:32M -x 0 -I 0 -o 1 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 737280/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 7.867573 GiB/sec, Avg_Latency: 15778.112500 usecs ops: 41 total_time 0.089370 secs
SUCCESS
/usr/local/gds/tools/gdsio -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 0 -o 0 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1031869/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 4.775355 GiB/sec, Avg_Latency: 426.503605 usecs ops: 3819 total_time 0.206072 secs
SUCCESS
/usr/local/gds/tools/gdsio -f /data/sanity/tests//sparse1G -d 0  -w 8 -s 1G -i 8M:32M -x 0 -I 0 -o 0 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 876544/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 8.036547 GiB/sec, Avg_Latency: 15991.738095 usecs ops: 49 total_time 0.104017 secs
SUCCESS
**************************************************
gdiso tests : 16 /  18 tests passed
**************************************************
Starting Offset Tests
TestCase:Read odd offset
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 616  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :616, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 616  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :616, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read odd gpu offsets 1, 2, 3, 4, 4K-1, 4K, 4K+1, 60K, 64K, 68K
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 4096 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 4096 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 2 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :2, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 3 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :3, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4095 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4095, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4096 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4096, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4097 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4097, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4097 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4097, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 61440 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :61440, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 65536 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :65536, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 69632 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :69632, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 2 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :2, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 3 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :3, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4095 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4095, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4096 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4096, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4097 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :4097, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 61440 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :61440, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 65536 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :65536, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 69632 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :69632, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write odd size - sync
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485761 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :10485761, io_chunk_size :10485761, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write odd size - async
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485761 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :10485761, io_chunk_size :10485761, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:odd offset and odd size - sync
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 10485748 -o 119  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :119, io_requested :10485748, io_chunk_size :10485748, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:odd offset and odd size - async
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 10485748 -o 119  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :119, io_requested :10485748, io_chunk_size :10485748, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write 1 byte from offset 0 (sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 1 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1, io_chunk_size :1, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 1 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1, io_chunk_size :1, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write 1 byte from offset 3 (sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 1 -o 3  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :3, io_requested :1, io_chunk_size :1, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 1 -o 3  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :3, io_requested :1, io_chunk_size :1, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write big file 10G (odd size) - sync
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 1 -s 220201060 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :220201060, io_chunk_size :220201060, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write big file 10G (odd size) - async
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparserandom_big -n 1 -m 0 -s 220201060 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparserandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :220201060, io_chunk_size :220201060, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF (read 2G on a 1G file - async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparse1G -n 1 -m 0 -s 209714688 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparse1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714688, io_chunk_size :209714688, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF (read 2G on a 1G file - sync)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparse1G -n 1 -m 1 -s 209714688 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparse1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714688, io_chunk_size :209714688, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF - odd size (read 2G on a 1G file - sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparse1G -n 1 -m 0 -s 209714689 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparse1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714689, io_chunk_size :209714689, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparse1G -n 1 -m 1 -s 209714689 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//sparse1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714689, io_chunk_size :209714689, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF odd offset (read 2G on a 1G file - sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//sparse1G -n 1 -m 1 -s 209714688 -o 616  -d 0 -t 0 -p 0