Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-17107

Seeking Advice on Efficient Data Migration Methods

XMLWordPrintable

    • Icon: Question/Request Question/Request
    • Resolution: Unresolved
    • Icon: Minor Minor
    • None
    • Lustre 2.15.2
    • None
    • RHEL8
    • 3
    • 9223372036854775807

      Hi,

      In our last data migration efforts involving 50 OSS servers, we observed slow migration speeds even though we used a lot of concurrent threads with the lfs_migrate command. To address this, we switched to the cp and mv methods later, which greatly enhanced our migration speed.

      The migration command we initially used is as below:

      lfs find --ost ost_name /mount/point | lfs_migrate -y

       

      As we prepare for our next migration task, I'd like to know if there are better migration methods we haven't considered yet.

      Thank you for your guidance,

      Jane

            cfaber Colin Faber - TLC
            lustre-sphnx BNL Team
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: