starting tests:Mon May 23 21:39:49 UTC 2022
os release:
Linux a100-01 5.4.0-109-generic #123-Ubuntu SMP Fri Apr 8 09:10:54 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
nvidia-smi:
Mon May 23 21:39:49 2022       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.43.04    Driver Version: 515.43.04    CUDA Version: 11.7     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A100-SXM...  On   | 00000000:07:00.0 Off |                    0 |
| N/A   27C    P0    53W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A100-SXM...  On   | 00000000:0F:00.0 Off |                    0 |
| N/A   26C    P0    54W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA A100-SXM...  On   | 00000000:47:00.0 Off |                    0 |
| N/A   27C    P0    53W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   3  NVIDIA A100-SXM...  On   | 00000000:4E:00.0 Off |                    0 |
| N/A   26C    P0    52W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   4  NVIDIA A100-SXM...  On   | 00000000:87:00.0 Off |                    0 |
| N/A   31C    P0    54W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   5  NVIDIA A100-SXM...  On   | 00000000:90:00.0 Off |                    0 |
| N/A   31C    P0    58W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   6  NVIDIA A100-SXM...  On   | 00000000:B7:00.0 Off |                    0 |
| N/A   31C    P0    55W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   7  NVIDIA A100-SXM...  On   | 00000000:BD:00.0 Off |                    0 |
| N/A   31C    P0    53W / 400W |      0MiB / 40960MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
using path /data/sanity SPARSE_FILES = false CREATE_FILES = true BIG BARSIZE = false 
nvidia_fs             245760  0
Begin nvidia-fs:
GDS Version: 1.3.0.44 
NVFS statistics(ver: 4.0)
NVFS Driver(version: 2.12.4)
Mellanox PeerDirect Supported: False
IO stats: Disabled, peer IO stats: Disabled
Logging level: info

Active Shadow-Buffer (MiB): 0
Active Process: 0
Reads				: err=0 io_state_err=0
Sparse Reads		        : n=0 io=0 holes=0 pages=0 
Writes				: err=0 io_state_err=0 pg-cache=0 pg-cache-fail=0 pg-cache-eio=0
Mmap				: n=8 ok=8 err=0 munmap=8
Bar1-map			: n=8 ok=8 err=0 free=8 callbacks=0 active=0
Error				: cpu-gpu-pages=0 sg-ext=0 dma-map=0 dma-ref=0
Ops				: Read=0 Write=0 BatchIO=0
GPU 0000:4e:00.0  uuid:b6f94773-211d-429a-dbdf-6823df80ba88 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:bd:00.0  uuid:599a30af-eed5-cfba-6746-8d5bd2c30133 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:b7:00.0  uuid:85ab4c50-7c74-1fdd-8e8d-3b55328533a1 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:87:00.0  uuid:3ad4d79b-90cc-00bd-d3d5-adf5084844e3 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:90:00.0  uuid:7d3cdaf1-7dae-30cd-f888-7319ef2abbb1 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:47:00.0  uuid:63bf04f1-2e24-73ea-76a9-bb8bde9cdfc9 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:07:00.0  uuid:30f846a7-21d0-057e-15b6-472ba0e5ab17 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:0f:00.0  uuid:e8992b2c-1ea8-319d-6015-1d507015760c : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
loading nvidia_peermem
nvidia_peermem         16384  0
ib_core               348160  10 rdma_cm,ib_ipoib,ko2iblnd,nvidia_peermem,iw_cm,ib_umad,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm
nvidia              39620608  437 nvidia_uvm,nvidia_peermem,nvidia_modeset
creating regular files
gdscheck.py tests
gdscheck.py python3 tests
=========================
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64
 ============
 ENVIRONMENT:
 ============
 =====================
 DRIVER CONFIGURATION:
 =====================
 NVMe               : Unsupported
 NVMeOF             : Unsupported
 SCSI               : Unsupported
 ScaleFlux CSD      : Unsupported
 NVMesh             : Unsupported
 DDN EXAScaler      : Supported
 IBM Spectrum Scale : Unsupported
 NFS                : Unsupported
 BeeGFS             : Unsupported
 WekaFS             : Unsupported
 Userspace RDMA     : Unsupported
 --Mellanox PeerDirect : Enabled
 --rdma library        : Not Loaded (libcufile_rdma.so)
 --rdma devices        : Not configured
 --rdma_device_status  : Up: 0 Down: 0
 =====================
 CUFILE CONFIGURATION:
 =====================
 properties.use_compat_mode : false
 properties.force_compat_mode : false
 properties.gds_rdma_write_support : true
 properties.use_poll_mode : false
 properties.poll_mode_max_size_kb : 4
 properties.max_batch_io_size : 128
 properties.max_batch_io_timeout_msecs : 5
 properties.max_direct_io_size_kb : 16384
 properties.max_device_cache_size_kb : 131072
 properties.max_device_pinned_mem_size_kb : 33554432
 properties.posix_pool_slab_size_kb : 4 1024 16384 
 properties.posix_pool_slab_count : 128 64 32 
 properties.rdma_peer_affinity_policy : RoundRobin
 properties.rdma_dynamic_routing : 0
 fs.generic.posix_unaligned_writes : false
 fs.lustre.posix_gds_min_kb: 0
 fs.beegfs.posix_gds_min_kb: 0
 fs.weka.rdma_write_support: false
 profile.nvtx : false
 profile.cufile_stats : 0
 miscellaneous.api_check_aggressive : false
 =========
 GPU INFO:
 =========
 GPU index 0 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 1 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 2 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 3 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 4 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 5 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 6 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 7 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 ==============
 PLATFORM INFO:
 ==============
 IOMMU: disabled
 Platform verification succeeded

SUCCESS
FILESYSTEM VERSION CHECK:
ofed_info:
current version: MLNX_OFED_LINUX-5.6-1.0.3.3: (Supported)
min version supported: MLNX_OFED_LINUX-4.6-1.0.1.1
SUCCESS
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64

SUCCESS
usage: gdscheck.py [-h] [-p] [-f FILE] [-v] [-V]

GPUDirectStorage platform checker

optional arguments:
  -h, --help  show this help message and exit
  -p          gds platform check
  -f FILE     gds file check
  -v          gds version checks
  -V          gds fs checks
SUCCESS
gdscheck.py python2 tests
=========================
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64
 ============
 ENVIRONMENT:
 ============
 =====================
 DRIVER CONFIGURATION:
 =====================
 NVMe               : Unsupported
 NVMeOF             : Unsupported
 SCSI               : Unsupported
 ScaleFlux CSD      : Unsupported
 NVMesh             : Unsupported
 DDN EXAScaler      : Supported
 IBM Spectrum Scale : Unsupported
 NFS                : Unsupported
 BeeGFS             : Unsupported
 WekaFS             : Unsupported
 Userspace RDMA     : Unsupported
 --Mellanox PeerDirect : Enabled
 --rdma library        : Not Loaded (libcufile_rdma.so)
 --rdma devices        : Not configured
 --rdma_device_status  : Up: 0 Down: 0
 =====================
 CUFILE CONFIGURATION:
 =====================
 properties.use_compat_mode : false
 properties.force_compat_mode : false
 properties.gds_rdma_write_support : true
 properties.use_poll_mode : false
 properties.poll_mode_max_size_kb : 4
 properties.max_batch_io_size : 128
 properties.max_batch_io_timeout_msecs : 5
 properties.max_direct_io_size_kb : 16384
 properties.max_device_cache_size_kb : 131072
 properties.max_device_pinned_mem_size_kb : 33554432
 properties.posix_pool_slab_size_kb : 4 1024 16384 
 properties.posix_pool_slab_count : 128 64 32 
 properties.rdma_peer_affinity_policy : RoundRobin
 properties.rdma_dynamic_routing : 0
 fs.generic.posix_unaligned_writes : false
 fs.lustre.posix_gds_min_kb: 0
 fs.beegfs.posix_gds_min_kb: 0
 fs.weka.rdma_write_support: false
 profile.nvtx : false
 profile.cufile_stats : 0
 miscellaneous.api_check_aggressive : false
 =========
 GPU INFO:
 =========
 GPU index 0 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 1 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 2 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 3 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 4 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 5 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 6 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 7 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 ==============
 PLATFORM INFO:
 ==============
 IOMMU: disabled
 Platform verification succeeded

SUCCESS
FILESYSTEM VERSION CHECK:
ofed_info:
current version: MLNX_OFED_LINUX-5.6-1.0.3.3: (Supported)
min version supported: MLNX_OFED_LINUX-4.6-1.0.1.1
SUCCESS
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64

SUCCESS
usage: gdscheck.py [-h] [-p] [-f FILE] [-v] [-V]

GPUDirectStorage platform checker

optional arguments:
  -h, --help  show this help message and exit
  -p          gds platform check
  -f FILE     gds file check
  -v          gds version checks
  -V          gds fs checks
SUCCESS
gdscheck.py current running python tests
=========================
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64
 ============
 ENVIRONMENT:
 ============
 =====================
 DRIVER CONFIGURATION:
 =====================
 NVMe               : Unsupported
 NVMeOF             : Unsupported
 SCSI               : Unsupported
 ScaleFlux CSD      : Unsupported
 NVMesh             : Unsupported
 DDN EXAScaler      : Supported
 IBM Spectrum Scale : Unsupported
 NFS                : Unsupported
 BeeGFS             : Unsupported
 WekaFS             : Unsupported
 Userspace RDMA     : Unsupported
 --Mellanox PeerDirect : Enabled
 --rdma library        : Not Loaded (libcufile_rdma.so)
 --rdma devices        : Not configured
 --rdma_device_status  : Up: 0 Down: 0
 =====================
 CUFILE CONFIGURATION:
 =====================
 properties.use_compat_mode : false
 properties.force_compat_mode : false
 properties.gds_rdma_write_support : true
 properties.use_poll_mode : false
 properties.poll_mode_max_size_kb : 4
 properties.max_batch_io_size : 128
 properties.max_batch_io_timeout_msecs : 5
 properties.max_direct_io_size_kb : 16384
 properties.max_device_cache_size_kb : 131072
 properties.max_device_pinned_mem_size_kb : 33554432
 properties.posix_pool_slab_size_kb : 4 1024 16384 
 properties.posix_pool_slab_count : 128 64 32 
 properties.rdma_peer_affinity_policy : RoundRobin
 properties.rdma_dynamic_routing : 0
 fs.generic.posix_unaligned_writes : false
 fs.lustre.posix_gds_min_kb: 0
 fs.beegfs.posix_gds_min_kb: 0
 fs.weka.rdma_write_support: false
 profile.nvtx : false
 profile.cufile_stats : 0
 miscellaneous.api_check_aggressive : false
 =========
 GPU INFO:
 =========
 GPU index 0 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 1 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 2 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 3 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 4 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 5 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 6 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 GPU index 7 NVIDIA A100-SXM4-40GB bar:1 bar size (MiB):65536 supports GDS
 ==============
 PLATFORM INFO:
 ==============
 IOMMU: disabled
 Platform verification succeeded

SUCCESS
FILESYSTEM VERSION CHECK:
ofed_info:
current version: MLNX_OFED_LINUX-5.6-1.0.3.3: (Supported)
min version supported: MLNX_OFED_LINUX-4.6-1.0.1.1
SUCCESS
 GDS release version: 1.3.0.44
 nvidia_fs version:  2.12 libcufile version: 2.12
 Platform: x86_64

SUCCESS
usage: gdscheck.py [-h] [-p] [-f FILE] [-v] [-V]

GPUDirectStorage platform checker

optional arguments:
  -h, --help  show this help message and exit
  -p          gds platform check
  -f FILE     gds file check
  -v          gds version checks
  -V          gds fs checks
SUCCESS
**************************************************
gdscheck.py test results : 12 /  12 tests passed
**************************************************
Starting basic gdsio Tests
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 4k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 252/256(KiB) IOSize: 4(KiB) Throughput: 0.001413 GiB/sec, Avg_Latency: 306.710181 usecs ops: 63 total_time 0.170081 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 3k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 246/256(KiB) IOSize: 3(KiB) Throughput: 0.014761 GiB/sec, Avg_Latency: 354.480357 usecs ops: 82 total_time 0.015894 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 3k -o 1
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 243/256(KiB) IOSize: 3(KiB) Throughput: 0.009079 GiB/sec, Avg_Latency: 591.872561 usecs ops: 81 total_time 0.025525 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 2k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 250/256(KiB) IOSize: 2(KiB) Throughput: 0.009855 GiB/sec, Avg_Latency: 358.388448 usecs ops: 125 total_time 0.024192 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 2k -o 1
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 246/256(KiB) IOSize: 2(KiB) Throughput: 0.005957 GiB/sec, Avg_Latency: 613.324432 usecs ops: 123 total_time 0.039385 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 1k
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 251/256(KiB) IOSize: 1(KiB) Throughput: 0.005419 GiB/sec, Avg_Latency: 340.107025 usecs ops: 251 total_time 0.044175 secs
SUCCESS
/usr/local/gds/tools/gdsio -f  /data/sanity/tests//reg1G -d 0 -f /data/sanity/tests//reg1G -d 0 -s 128K -i 1k -o 1
IoType: READ XferType: GPUD Threads: 2 DataSetSize: 247/256(KiB) IOSize: 1(KiB) Throughput: 0.002903 GiB/sec, Avg_Latency: 646.720889 usecs ops: 247 total_time 0.081155 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 1 -o 1
IoType: WRITE XferType: GPUD Threads: 8 DataSetSize: 916762/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 0.612310 GiB/sec, Avg_Latency: 3182.875953 usecs ops: 3583 total_time 1.427859 secs
Verifying data 
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1023878/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 4.075352 GiB/sec, Avg_Latency: 495.431788 usecs ops: 3803 total_time 0.239598 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 3 -k 1234 -o 1
IoType: RANDWRITE XferType: GPUD Threads: 8 DataSetSize: 1005232/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 1.165685 GiB/sec, Avg_Latency: 3517.258113 usecs ops: 1861 total_time 0.822404 secs
Verifying data 
IoType: RANDREAD XferType: GPUD Threads: 8 DataSetSize: 1032208/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 6.392850 GiB/sec, Avg_Latency: 626.787669 usecs ops: 1912 total_time 0.153983 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -D /data/sanity/tests// -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 1 -o 1
Error: IO failed stopping traffic, fd :51 ret:-5 errno :1
Error: IO failed stopping traffic, fd :49 ret:-5 errno :1
Error: IO failed stopping traffic, fd :52 ret:-5 errno :1
Error: IO failed stopping traffic, fd :56 ret:-5 errno :1
Error: IO failed stopping traffic, fd :54 ret:-5 errno :1
Error: IO failed stopping traffic, fd :55 ret:-5 errno :1
FAILED
/usr/local/gds/tools/gdsio -V -D /data/sanity/tests// -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 3 -k 1234 -o 1
IoType: RANDWRITE XferType: GPUD Threads: 8 DataSetSize: 8165265/8388608(KiB) IOSize: 32-1024-1(KiB) Throughput: 1.499461 GiB/sec, Avg_Latency: 2640.743117 usecs ops: 15722 total_time 5.193203 secs
Verifying data 
IoType: RANDREAD XferType: GPUD Threads: 8 DataSetSize: 8187185/8388608(KiB) IOSize: 32-1024-1(KiB) Throughput: 6.713160 GiB/sec, Avg_Latency: 587.913324 usecs ops: 15769 total_time 1.163075 secs
SUCCESS
/usr/local/gds/tools/gdsio -D /data/sanity/tests// -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 3 -k 1234 -o 1 -F -R
IoType: RANDWRITE XferType: GPUD Threads: 8 DataSetSize: 8127541/8388608(KiB) IOSize: 32-1024-1(KiB) Throughput: 1.570280 GiB/sec, Avg_Latency: 2513.310167 usecs ops: 15649 total_time 4.936079 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 1 -o 1 -b
IoType: WRITE XferType: GPUD Threads: 8 DataSetSize: 927062/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 0.627545 GiB/sec, Avg_Latency: 3115.242871 usecs ops: 3605 total_time 1.408847 secs
Verifying data 
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 996682/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 3.853179 GiB/sec, Avg_Latency: 518.737660 usecs ops: 3749 total_time 0.246682 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 8M:32M -x 0 -I 1 -o 1 -b
IoType: WRITE XferType: GPUD Threads: 8 DataSetSize: 737280/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 3.836343 GiB/sec, Avg_Latency: 33080.320833 usecs ops: 41 total_time 0.183280 secs
Verifying data 
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 737280/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 7.564795 GiB/sec, Avg_Latency: 17324.400000 usecs ops: 41 total_time 0.092947 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 0 -o 1 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1028307/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 4.081873 GiB/sec, Avg_Latency: 496.261123 usecs ops: 3812 total_time 0.240250 secs
SUCCESS
/usr/local/gds/tools/gdsio -V -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 8M:32M -x 0 -I 0 -o 1 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 737280/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 7.697718 GiB/sec, Avg_Latency: 16305.562500 usecs ops: 41 total_time 0.091342 secs
SUCCESS
/usr/local/gds/tools/gdsio -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 32K:1024K:1K -x 0 -I 0 -o 0 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 1034400/1048576(KiB) IOSize: 32-1024-1(KiB) Throughput: 4.823536 GiB/sec, Avg_Latency: 422.496583 usecs ops: 3824 total_time 0.204514 secs
SUCCESS
/usr/local/gds/tools/gdsio -f /data/sanity/tests//reg1G -d 0  -w 8 -s 1G -i 8M:32M -x 0 -I 0 -o 0 -b
IoType: READ XferType: GPUD Threads: 8 DataSetSize: 876544/1048576(KiB) IOSize: 8192-32768-8192(KiB) Throughput: 7.636225 GiB/sec, Avg_Latency: 16364.726190 usecs ops: 49 total_time 0.109470 secs
SUCCESS
**************************************************
gdiso tests : 17 /  18 tests passed
**************************************************
Starting Offset Tests
TestCase:Read odd offset
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 616  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :616, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 616  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :616, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read odd gpu offsets 1, 2, 3, 4, 4K-1, 4K, 4K+1, 60K, 64K, 68K
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 4096 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 4096 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 2 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :2, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 3 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :3, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4095 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4095, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4096 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4096, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4097 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4097, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 4097 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4097, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 61440 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :61440, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 65536 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :65536, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 69632 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :69632, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 1 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :1, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 2 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :2, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 3 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :3, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4095 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4095, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4096 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4096, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 4097 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :4097, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 61440 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :61440, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 65536 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :65536, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 69632 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :69632, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write odd size - sync
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485761 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :10485761, io_chunk_size :10485761, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write odd size - async
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485761 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :10485761, io_chunk_size :10485761, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:odd offset and odd size - sync
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485748 -o 119  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :119, io_requested :10485748, io_chunk_size :10485748, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:odd offset and odd size - async
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485748 -o 119  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :119, io_requested :10485748, io_chunk_size :10485748, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write 1 byte from offset 0 (sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 1 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1, io_chunk_size :1, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 1 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1, io_chunk_size :1, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write 1 byte from offset 3 (sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 1 -o 3  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :3, io_requested :1, io_chunk_size :1, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 1 -o 3  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :3, io_requested :1, io_chunk_size :1, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write big file 10G (odd size) - sync
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 220201060 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :220201060, io_chunk_size :220201060, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read/write big file 10G (odd size) - async
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 220201060 -o 4096  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4096, io_requested :220201060, io_chunk_size :220201060, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF (read 2G on a 1G file - async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1G -n 1 -m 0 -s 209714688 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714688, io_chunk_size :209714688, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF (read 2G on a 1G file - sync)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1G -n 1 -m 1 -s 209714688 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714688, io_chunk_size :209714688, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF - odd size (read 2G on a 1G file - sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1G -n 1 -m 0 -s 209714689 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714689, io_chunk_size :209714689, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1G -n 1 -m 1 -s 209714689 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :209714689, io_chunk_size :209714689, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond EOF odd offset (read 2G on a 1G file - sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1G -n 1 -m 1 -s 209714688 -o 616  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :616, io_requested :209714688, io_chunk_size :209714688, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1G -n 1 -m 0 -s 209714688 -o 616  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1G, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :616, io_requested :209714688, io_chunk_size :209714688, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read size beyond EOF (small file)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 1099 -o 1  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1, io_requested :1099, io_chunk_size :1099, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 1099 -o 1  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1, io_requested :1099, io_chunk_size :1099, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 1099 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1099, io_chunk_size :1099, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 1099 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1099, io_chunk_size :1099, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read just short of EOF
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 1000 -o 1  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1, io_requested :1000, io_chunk_size :1000, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 1000 -o 1  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1, io_requested :1000, io_chunk_size :1000, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 1000 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1000, io_chunk_size :1000, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 1000 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :1000, io_chunk_size :1000, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read offset from EOF
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 999 -o 1024  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1024, io_requested :999, io_chunk_size :999, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 999 -o 1024  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1024, io_requested :999, io_chunk_size :999, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 1 -o 1024  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1024, io_requested :1, io_chunk_size :1, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 1 -o 1024  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1024, io_requested :1, io_chunk_size :1, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read offset beyond EOF (sync and async)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 1 -s 1 -o 1025  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1025, io_requested :1, io_chunk_size :1, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//reg1K -n 1 -m 0 -s 1 -o 1025  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//reg1K, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1025, io_requested :1, io_chunk_size :1, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read with odd gpu_offset
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read with odd gpu_offset and odd file offset
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 617  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :617, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 617  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :617, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read at 128k GPU page offset
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Read beyond 64k (odd gpu offset)
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 10485760 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 10485760 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :10485760, io_chunk_size :10485760, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Overwrite an existing file within EOF
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 52428800 -o 1  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1, io_requested :52428800, io_chunk_size :52428800, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 52428800 -o 1  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :1, io_requested :52428800, io_chunk_size :52428800, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 52428805 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :52428805, io_chunk_size :52428805, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 52428805 -o 0  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :0, io_requested :52428805, io_chunk_size :52428805, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:Offset beyond EOF writes
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 4096 -o 4099  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4099, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 4096 -o 4099  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4099, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:offset just short of EOF writes
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 3 -o 4094  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4094, io_requested :3, io_chunk_size :3, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 3 -o 4094  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :4094, io_requested :3, io_chunk_size :3, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
TestCase:offset from EOF writes
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 0 -s 4096 -o 3  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :3, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :0, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
/usr/local/gds/tools/gdsio_verify  -f /data/sanity/tests//regrandom_big -n 1 -m 1 -s 4096 -o 3  -d 0 -t 0 -p 0
gpu index :0,file :/data/sanity/tests//regrandom_big, gpu buffer alignment :0, gpu buffer offset :0, gpu devptr offset :0, file offset :3, io_requested :4096, io_chunk_size :4096, bufregister :true, sync :1, nr ios :1, 
fsync :0, 
Batch mode: 0
Data Verification Success
SUCCESS
**************************************************
File offset and GPU Buffer offset Tests : 73 /  73 tests passed
**************************************************
running cufile sample tests
sample 1
opening file /data/sanity/tests//reg1G_sample1
registering device memory of size :131072
writing from device memory
written bytes :131072
deregistering device memory
SUCCESS
sample 2
opening file /data/sanity/tests//reg1G_sample2
allocating device memory of size :1048576 gpu id: 0
writing from gpuid: 0
written bytes :1048576
SUCCESS
sample 3
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_verify_sample4
f820f56487e3d3ec1f8c74d28488b660f5e942fceb2b22fb403c83be239277
f820f56487e3d3ec1f8c74d28488b660f5e942fceb2b22fb403c83be239277
SHA SUM Match
SUCCESS
sample 4
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_verify_sample5
43f3c717abd9eeb1fd9190ab9b567ceeea2cef957ab7d335296a22461b785
43f3c717abd9eeb1fd9190ab9b567ceeea2cef957ab7d335296a22461b785
SHA SUM Match
SUCCESS
sample 5
reading file to device memory : /data/sanity/tests//reg1G
read bytes : 1048576
writing from device memory, buffer OFFSET :131072 to file :/data/sanity/tests//reg1G_verify_sample6
2067432838a91d5a21e24f123b6552bf83307797d975f73d3a5ba7a11cf91b6d
2067432838a91d5a21e24f123b6552bf83307797d975f73d3a5ba7a11cf91b6d
SHA SUM Match
SUCCESS
sample 6
reading file size(bytes):16777216
reading file sequentially :/data/sanity/tests//reg1G chunk size : 65536
Total chunks read :256
writing device memory to file :/data/sanity/tests//reg1G_verify_sample7
ff764166ff9e4496d2fa8735c0ace9e8ac44e68beb571831dda1f78983b8fa41
ff764166ff9e4496d2fa8735c0ace9e8ac44e68beb571831dda1f78983b8fa41
SHA SUM Match
SUCCESS
sample 7
SUCCESS
sample 8
PASS: cufile success status:Success
SUCCESS
sample 14
opening file /data/sanity/tests//reg1G
registering device memory of size :1048576
reading file sequentially :/data/sanity/tests//reg1G chunk size : 65536
Total chunks read :16
writing device memory to file :/data/sanity/tests//reg1G_verify_sample8
wrote bytes :1048576
c22ce94a5bf7728fe2172ca63d26bb12d9dbbc1b6b50c39f57bf26e4579d59e8
c22ce94a5bf7728fe2172ca63d26bb12d9dbbc1b6b50c39f57bf26e4579d59e8
SHA SUM Match
SUCCESS
sample 15
using cudaMalloc
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_verify_sample4
79ddec9e554fdbd9caf08021fe77a22b9d8784a110c655bf0de42de9b38c4e4
79ddec9e554fdbd9caf08021fe77a22b9d8784a110c655bf0de42de9b38c4e4
SHA SUM Match
SUCCESS
**************************************************
cufile sample tests : 10 /  10 tests passed
**************************************************
Testing gdscp functionality
/usr/local/gds/tools/gdscp /data/sanity/tests//reg1G /data/sanity/tests//reg1G_copy 0 -v
gpu md5:92df3d5e4f18fea78fc4bbcf64c85f3c
cpu md5:92df3d5e4f18fea78fc4bbcf64c85f3c
md5sum Match!!
SUCCESS
**************************************************
gdscp tests : 1 /  1 tests passed
**************************************************
Testing Batch State Machine
/usr/local/gds/tools//tests/cufile_batch_test_state_machine /data/sanity/tests//reg1G 0 && pass || fail
Preparation for Batch IO complete
Test successful for state ID BATCH_TEST_IDLE_STATE
SUCCESS
/usr/local/gds/tools//tests/cufile_batch_test_state_machine /data/sanity/tests//reg1G 1 && pass || fail
Test successful for state ID BATCH_TEST_ACTIVE_STATE
SUCCESS
/usr/local/gds/tools//tests/cufile_batch_test_state_machine /data/sanity/tests//reg1G 2 && pass || fail
Testing pending to cancel
Preparation for Batch IO complete
Testing pending to destroy
Preparation for Batch IO complete
Testing mutliple IO get Status
Preparation for Batch IO complete
Testing for num entries = 4
Test passed for get_status_size 4, Got entries 56
Testing for num entries = 8
Test passed for get_status_size 8, Got entries 8
Testing get status for entries more than batch_size
Preparation for Batch IO complete
Testing for num entries = 65, batch size = 64
Test passed for get_status_size 65, Got entries 64
Testing get status for 0 batch_size
Preparation for Batch IO complete
Testing for num entries = 0, batch size = 64
Test passed for get_status_size 0, Got entries 56
Testing get status for minimum entries = batch_size
Preparation for Batch IO complete
Testing for num entries = 64, batch size = 64
Test passed for get_status_size 64, Got entries 64
Testing get status with a timeout value
Preparation for Batch IO complete
Testing for num entries = 64
Test passed for get_status_size 64, Got entries 56
Test passed for get_status_size 8, Got entries 2
Test passed for get_status_size 6, Got entries 5
Test passed for get_status_size 1, Got entries 1
Test passed for get_status_size 0, Got entries err = 5030
Testing get status cookie values
Preparation for Batch IO complete
Testing for num entries = 64
Test passed for get_status_size 64, Got entries 57
Test passed for get_status_size 7, Got entries 2
Test passed for get_status_size 5, Got entries 3
Test passed for get_status_size 2, Got entries 2
Testing get status max nr > min nr
Preparation for Batch IO complete
Testing for min nr = 64, max nr = 63 batch size = 64
Test passed for get_status_size 64, Got error = 5030
Testing get status max_nr
Preparation for Batch IO complete
Test finished successfully for testing max nr
Testing get status multiple threads
Preparation for Batch IO complete
Testing nvfs+compat mode in a single batch
Test successful for state ID BATCH_TEST_PENDING_STATE
SUCCESS
/usr/local/gds/tools//tests/cufile_batch_test_state_machine /data/sanity/tests//reg1G 3 && pass || fail
Preparation for Batch IO complete
Test successful for state ID BATCH_TEST_CANCEL_STATE
SUCCESS
/usr/local/gds/tools//tests/cufile_batch_test_state_machine /data/sanity/tests//reg1G 4 && pass || fail
Test destroy and setup again
Test Destroying the same ID twice
Test successful for state ID BATCH_TEST_DESTROY_STATE
SUCCESS
**************************************************
Batch State Machine Tests : 5 /  5 tests passed
**************************************************
Performing cufile API tests
/usr/local/gds/tools//api_tests/cufile_testbufregister 0
test 0: cufile buffer register ok: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 1
test 1: cufile buffer register : pointer range exceeds allocated address range
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 2
test 2: cufile buffer register : Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 3
test 3: cufile buffer register error: invalid device pointer
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 4
test 4: cufile buffer register error: invalid arguments
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 5
test 5: cufile buffer register error: invalid pointer memory type
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 6
test 6: cufile buffer register error: invalid pointer memory type
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 7
test 7: cufile buffer register error: invalid device pointer
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 8
test 8: cufile buffer register error: invalid pointer memory type
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 9
test 9: cufile buffer register error: invalid pointer memory type
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufregister 10
test 10: cufile buffer register error: invalid pointer memory type
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufderegister 0
test 0: cufile buffer deregister ok: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufderegister 1
test 1: cufile buffer deregister error: device pointer lookup failure
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufderegister 2
test 2: cufile buffer deregister ok Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufderegister 3
test 3: cufile buffer deregister ok Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufderegister 4
test 4: cufile buffer deregister err device pointer already registered
test 4: cufile buffer deregister ok Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testbufderegister 5
test 5: cufile buffer deregister error invalid arguments
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testclosefd /data/sanity/tests//reg1G 0
cufile destroy done
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testclosefd /data/sanity/tests//reg1G 1
cufile destroy skipped
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testclosefd /data/sanity/tests//reg1G 2
cufile destroy invalid handle
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testclosefd /data/sanity/tests//reg1G 3
cufile destroy invalid handle
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriver 0
cufile driver open: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriver 1
cufile driver open: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriver 2
cufile driver close: nvidia-fs driver is not loaded
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenfd  /data/sanity/tests//reg1G 0
cufile register :Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenfd  /data/sanity/tests//reg1G 1
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenfd  /data/sanity/tests//reg1G 2
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenfd  /data/sanity/tests//reg1G 3
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenfd  /data/sanity/tests//reg1G 4
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenfd  /data/sanity/tests//reg1G 5
SUCCESS
/usr/local/gds/tools//api_tests/cufile_rw  /data/sanity/tests//reg1G /data/sanity/tests//reg1G_VERIFY 0 
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_VERIFY
18b0e453b5c03f553de2dab76bc371538185ba5e41d73ace170689d94fc2bc9
18b0e453b5c03f553de2dab76bc371538185ba5e41d73ace170689d94fc2bc9
SHA SUM Match
SUCCESS
/usr/local/gds/tools//api_tests/cufile_rwmanaged  /data/sanity/tests//reg1G 0 
reading file to device memory :/data/sanity/tests//reg1G
SUCCESS
/usr/local/gds/tools//api_tests/cufile_rw_unreg  /data/sanity/tests//reg1G /data/sanity/tests//reg1G_VERIFY 0 1
using cudaMalloc
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_VERIFY
fad69cf7844ff8c622d881f2ff171411c22dcff06183c6dda666ff421944
fad69cf7844ff8c622d881f2ff171411c22dcff06183c6dda666ff421944
SHA SUM Match
SUCCESS
/usr/local/gds/tools//api_tests/cufile_rw_unreg  /data/sanity/tests//reg1G /data/sanity/tests//reg1G_VERIFY 0 2
using cudaMallocManaged
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_VERIFY
a91f61dbd06f81eadfefec9cb909718498bd9e7c161cd9c3f2168956e59610
a91f61dbd06f81eadfefec9cb909718498bd9e7c161cd9c3f2168956e59610
SHA SUM Match
SUCCESS
/usr/local/gds/tools//api_tests/cufile_rw_unreg  /data/sanity/tests//reg1G /data/sanity/tests//reg1G_VERIFY 0 3
using cudaMallocHost
reading file to device memory :/data/sanity/tests//reg1G
writing device memory to file :/data/sanity/tests//reg1G_VERIFY
c3efedabb9293ef171e625f332da624cb5f326b2dc0286a2977a2f6afeb4060
c3efedabb9293ef171e625f332da624cb5f326b2dc0286a2977a2f6afeb4060
SHA SUM Match
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 0
cufile register : Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 1
cufile register : Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 2
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 3
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 4
cufile register : Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 5
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 6
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 7
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 8
cufile register : Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testopenflags /data/sanity/tests//reg1G 9
cufile register : Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriverprops -p 8
cufile driver set/get properties: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriverprops -b 8
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriverprops -d 8
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriverprops -c 8
cufile driver set/get properties: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriverprops -b 1024
cufile driver set/get properties: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testdriverprops -d 1024
cufile driver set/get properties: Success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_driver_close /data/sanity/tests//reg1G /data/sanity/tests//reg1G 0
SUCCESS
/usr/local/gds/tools//api_tests/cufile_driver_close /data/sanity/tests//reg1G /data/sanity/tests//reg1G 1
SUCCESS
/usr/local/gds/tools//api_tests/cufile_driver_close /data/sanity/tests//reg1G /data/sanity/tests//reg1G 2
SUCCESS
/usr/local/gds/tools//api_tests/cufile_io_race /data/sanity/tests//reg1G 
cufile_io_race Returned success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testvalidnvbuf  /data/sanity/tests//reg1G 0 
opening file /data/sanity/tests//reg1G
devPtr :0x7f81e3200000 buf_id : 459
registering device memory of size :4096
writing from device memory
devPtr :0x7f81e3200000 buf_id : 460
deregistering device memory
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testvalidnvbuf  /data/sanity/tests//reg1G 0 
opening file /data/sanity/tests//reg1G
devPtr :0x7f30bb200000 buf_id : 459
registering device memory of size :4096
writing from device memory
devPtr :0x7f30bb200000 buf_id : 460
deregistering device memory
SUCCESS
/usr/local/gds/tools//api_tests/cufile_driver_close /data/sanity/tests//reg1G /data/sanity/tests//reg1G 3
SUCCESS
/usr/local/gds/tools//api_tests/cufile_io_race /data/sanity/tests//reg1G 
cufile_io_race Returned success
SUCCESS
/usr/local/gds/tools//api_tests/cufile_invalid_write /data/sanity/tests//reg1G 0 0
opening file /data/sanity/tests//reg1G
using device memory of size :131072
writing from device memory
deregistering device memory
SUCCESS
/usr/local/gds/tools//api_tests/cufile_invalid_write /data/sanity/tests//reg1G 0 1
opening file /data/sanity/tests//reg1G
using device memory of size :131072
writing from device memory
deregistering device memory
SUCCESS
/usr/local/gds/tools//api_tests/cufile_invalid_offsets /data/sanity/tests//reg1G 0 0
reading file to device memory :/data/sanity/tests//reg1G
SUCCESS
/usr/local/gds/tools//api_tests/cufile_testcudacontext_switch /data/sanity/tests//reg_CTX_VERIFY 0
ctx0:0x18ba770
ctx1:0x18ba770
ctx0:0x18ba770
ctx1:0x18ba770
SUCCESS
End: nvidia-fs:
GDS Version: 1.3.0.44 
NVFS statistics(ver: 4.0)
NVFS Driver(version: 2.12.4)
Mellanox PeerDirect Supported: True
IO stats: Disabled, peer IO stats: Disabled
Logging level: info

Active Shadow-Buffer (MiB): 0
Active Process: 0
Reads				: err=0 io_state_err=0
Sparse Reads		        : n=16136 io=0 holes=14 pages=14 
Writes				: err=6 io_state_err=0 pg-cache=1813 pg-cache-fail=0 pg-cache-eio=6
Mmap				: n=2100 ok=2100 err=0 munmap=2100
Bar1-map			: n=2100 ok=2100 err=0 free=1920 callbacks=180 active=0
Error				: cpu-gpu-pages=0 sg-ext=0 dma-map=0 dma-ref=0
Ops				: Read=0 Write=0 BatchIO=0
GPU 0000:4e:00.0  uuid:b6f94773-211d-429a-dbdf-6823df80ba88 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=44 
GPU 0000:bd:00.0  uuid:599a30af-eed5-cfba-6746-8d5bd2c30133 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:b7:00.0  uuid:85ab4c50-7c74-1fdd-8e8d-3b55328533a1 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:87:00.0  uuid:3ad4d79b-90cc-00bd-d3d5-adf5084844e3 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:90:00.0  uuid:7d3cdaf1-7dae-30cd-f888-7319ef2abbb1 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=1 
GPU 0000:47:00.0  uuid:63bf04f1-2e24-73ea-76a9-bb8bde9cdfc9 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=44 
GPU 0000:07:00.0  uuid:30f846a7-21d0-057e-15b6-472ba0e5ab17 : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=210 
GPU 0000:0f:00.0  uuid:e8992b2c-1ea8-319d-6015-1d507015760c : Registered_MiB=0 Cache_MiB=0 max_pinned_MiB=36 
**************************************************
API Tests, : 63 /  63 tests passed
**************************************************
Testsuite : 181 / 182 tests passed
done tests:Mon May 23 22:02:56 UTC 2022