[LU-11449] osc: send RPCs with random i/o Created: 30/Sep/18  Updated: 17/Feb/21  Resolved: 04/Sep/19

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major
Reporter: Patrick Farrell (Inactive) Assignee: Patrick Farrell (Inactive)
Resolution: Not a Bug Votes: 0
Labels: patch

Issue Links:
Related
is related to LU-10239 Lustre crash (client): The first exte... Resolved
is related to LU-11526 Support 64MB I/O RPC Resolved
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

LU-8515 modified osc_makes_rpc to remove a check which sent RPCs once the total number of pages == max_pages_per_rpc.  This fixed an issue with > 1 writer per stripe where smaller, fragmented RPCs would be sent instead of full size RPCs.

However, it introduced a different issue with small random writes, particularly when sparse.  Because small random writes will (in the large file/sparse case) not make complete, contiguous extents, no RPCs will be sent until the max_dirty_mb or grant limit is hit.

This means that in the small-random-sparse write case not enough RPCs will be sent.

The solution is to add an additional check for greater than max_pages_per_rpc pages.  Details in patch.



 Comments   
Comment by Gerrit Updater [ 30/Sep/18 ]

Patrick Farrell (paf@cray.com) uploaded a new patch: https://review.whamcloud.com/33255
Subject: LU-11449 osc: send RPCs for sparse writes
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 440f4f12c8311ad9cd1d2983272d767bc48693b6

Comment by Patrick Farrell (Inactive) [ 04/Sep/19 ]

Note from Gerrit, where patch is to be abandoned:

The theory of i/o performance I had in mind when I created this appears to be wrong... Basically, it's reasonable to wait for the cache limit to be hit, and it doesn't take long. This seems to be an unnecessary optimization.

Comment by Patrick Farrell (Inactive) [ 04/Sep/19 ]

Existing behavior turns out to be OK.

Generated at Sat Feb 10 02:43:58 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.