Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-2001

read operation is slow when mmap is enabled

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Minor
    • None
    • Lustre 1.8.8
    • lustre-1.8.8 CentOS5.8
    • 3
    • 8891

    Description

      There is an application and running on the lustre.

      When we run this application trough the lustre client, it's really slow and application seems to be stall.
      However, if the lustre exports lustre filesystem with NFS and mount it client itself, then application does IOs to lustre through the NFS, the performance seems to be reasonable.

      1. mount -t lustre
        192.168.100.131@tcp:/lustre on /lustre type lustre (rw)
      2. exportfs
        /lustre <world>
      3. mount -t nfs
        localhost:/lustre on /lustre-nfs type nfs (rw,addr=127.0.0.1)

      The application is doing the following operations.
      1. 4 jobs (same application) are running on the single client and these jobs read single shared file as input file. file is open with open() and mmap().
      2. computes with them and each job write output file separately. the block size 8k for read() and write().

      Any ideas why application is fast if it goes through the NFS layer to lustre?

      Attachments

        1. debug-1.txt.gz
          3.16 MB
        2. debug-2.txt.gz
          2.95 MB
        3. debug-3.txt.gz
          5.83 MB
        4. lustre.8.zip
          13 kB
        5. lustre-2.1.3-TCP-8thr.zip
          2 kB
        6. miss-rates.xlsx
          36 kB
        7. nfs_on_lustre.8.zip
          13 kB

        Activity

          People

            jay Jinshan Xiong (Inactive)
            ihara Shuichi Ihara (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: