Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-7475

lnetctl import not honoring nbuffers, credits, or mincredits

Details

    • Bug
    • Resolution: Fixed
    • Minor
    • Lustre 2.8.0
    • Lustre 2.7.0
    • None
    • RHEL 6.6
      lustre-client-2.7.1-2.6.32_504.30.3.el6.x86_64_g43f9fd9.x86_64
    • 3
    • 9223372036854775807

    Description

      Using lnetctl import produces different results than using lnet module parameters.

      Entry in lnet.conf modprobe file:

      options lnet check_routers_before_use=1 \
                   router_ping_timeout=130 \
                   dead_router_check_interval=300 \
                   live_router_check_interval=600\
                   tiny_router_buffers=8192 \
                   small_router_buffers=131072 \
                   large_router_buffers=4096 \
                   peer_buffer_credits=64
      
      options lnet forwarding="enabled"
      

      Will create the following setup:

      # lnetctl routing show
      routing:
          - cpt[0]:
                tiny:
                    npages: 0
                    nbuffers: 2048
                    credits: 2048
                    mincredits: 2048
                small:
                    npages: 1
                    nbuffers: 32768
                    credits: 32768
                    mincredits: 32768
                large:
                    npages: 256
                    nbuffers: 1024
                    credits: 1024
                    mincredits: 1024
      ......
      

      But, specifying these parameters in /etc/sysconfig/lnet.conf does not. Entry in /etc/sysconfig/lnet.conf:

      routing:
          - cpt[0]:
                tiny:
                    npages: 0
                    nbuffers: 2048
                    credits: 2048
                    mincredits: 2048
                small:
                    npages: 1
                    nbuffers: 32768
                    credits: 32768
                    mincredits: 32768
                large:
                    npages: 256
                    nbuffers: 1024
                    credits: 1024
                    mincredits: 1024
      

      Result:

      # lnetctl routing show
      routing:
          - cpt[0]:
                tiny:
                    npages: 0
                    nbuffers: 512
                    credits: 512
                    mincredits: 512
                small:
                    npages: 1
                    nbuffers: 4096
                    credits: 4096
                    mincredits: 4096
                large:
                    npages: 256
                    nbuffers: 256
                    credits: 256
                    mincredits: 256
      ......
      

      Are these settings not supported by lnetctl, or is using the module parameters still the preferred method?

      Thanks!
      –
      Jesse

      Attachments

        Activity

          People

            ashehata Amir Shehata (Inactive)
            hanleyja Jesse Hanley
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: