[LU-2424] add memory limits for ptlrpc service

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.4.0, Lustre 2.5.0
• Labels: patch
• Assignee: Liang Zhen (Inactive)
• Reporter: Andriy Skulysh

Description

Improve memmory allocation in case of huge request queues.

Limit number of request buffers in backlog, to avoid too expensive
memory using with LNet routers.
Allocate requests using cfs_mem_cache.
Allow only 1 thread to allocate request buffers.

Issue Links

• is related to: LU-1431 Support for larger than 1MB sequential I/O RPCs
• is related to: LU-2432 ptlrpc_alloc_rqbd spinning on vmap_area_lock on MDS

Comments

[Jian Yu]

replaced previous patch with request allocation using kmem_cache only http://review.whamcloud.com/#/c/6874/ .

The patch was back-ported to Lustre b2_4 branch: http://review.whamcloud.com/8445

[Jodi Levi (Inactive)]

Closing ticket as patches have landed to Master. Please let me know if more work is needed in this ticket and I will reopen.

[Andriy Skulysh]

replaced previous patch with request allocation using kmem_cache only http://review.whamcloud.com/#/c/6874/ .

[Liang Zhen (Inactive)]

patch is here: http://review.whamcloud.com/#change,4940

[Liang Zhen (Inactive)]

Please check discussion on LU-2432, we probably should fix memory pressure by have bigger request buffer.

[Andriy Skulysh]

PATCH: http://review.whamcloud.com/#change,4740

[Andriy Skulysh]

Xyratex-bug-id: MRP-689