[LU-14798] NVIDIA GPUDirect Storage Support

• Type: New Feature
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.15.0
• Assignee: Amir Shehata (Inactive)
• Reporter: Amir Shehata (Inactive)

Description

Now that NVIDIA has made the official release of GPUDirect Storage, we are able to release the GDS feature integration for Lustre that has been under development and testing in conjunction with NVIDIA for sometime.

This feature provides the following:

1. use direct bulk IO with GPU workload
2. Select the interface nearest the GPU for optimal performance
3. Integrate GPU selection criteria into the LNet multi-rail selection algorithm.
4. Handle IO less than 4K in a manner which works with the GPU direct workflow
5. Use the memory registration/deregistration mechanism provided by the nvidia-fs driver.

Performance comparison between GPU and CPU workloads attached. Bandwidth in GB/s.

 

Issue Links

• is related to: LU-14795 NVidia GDS support in lustre