[LU-16789] "lfs migrate" to use AIO/DIO or io_uring (kernel 5.1+)

• Type: Improvement
• Resolution: Unresolved
• Priority: Minor
• Labels: lug23dd lug24dd medium utils
• Assignee: Feng Lei
• Reporter: Andreas Dilger

Description

It would be useful to speed up "lfs migrate", "lfs mirror extend", and "lfs mirror resync" to use asynchronous Direct IO (AIO/DIO via libaio) to do the data copying

This should use the same mechanism as lustre/tests/aiocp.c to have a producer/consumer queue and submits some number of AIO read requests, and then submit the write requests when the reads finish.

Issue Links

• is related to: LU-17143 Use migrate_copy_data() for all data movement
• is related to: LU-18454 'lfs migrate' command can read file list from stdin or file
• is related to: LU-18455 Make 'lfs migrate' multi-threading
• is related to: LU-16587 Make lfs migrate faster
• is related to: LU-12649 Tracker for ongoing FLR improvements