Details
-
Improvement
-
Resolution: Fixed
-
Minor
-
Lustre 2.13.0
-
None
-
9223372036854775807
Description
Some tools that maintain copies of filesystem metadata in an external database monitor changelogs for changes to the filesystem, in order to determine files that need to be rescanned. This can result in a large number of small updates to the external database that can reduce the tool's ingest performance. It might be beneficial to instead track and scan complete directories that contain modified files and update the external database using bulk operations. Adding the parent FID to MTIME changelogs allows to more efficiently determine the parent directories for some types of file data modifications, by issuing OBD_IOC_FID2PATH once for each parent FID, instead of once for each file FID.
Attachments
Issue Links
- is related to
-
LU-16469 Add parent FID to CL_LAYOUT changelog records
-
- In Progress
-
Activity
| Fix Version/s | New: Lustre 2.14.0 [ 14490 ] | |
| Resolution | New: Fixed [ 1 ] | |
| Status | Original: In Progress [ 3 ] | New: Resolved [ 5 ] |
| Status | Original: Open [ 1 ] | New: In Progress [ 3 ] |
| Assignee | Original: WC Triage [ wc-triage ] | New: Nikitas Angelinas [ nangelinas ] |
| Comment |
[ A patch for master that uses the link EA to add the parent FID in the MDT is at https://review.whamcloud.com/#/c/37264/. We have not verified whether this affects performance negatively.
We think this patch could help in detecting some types of file data modifications, but not all, as MTIME changelogs don't seem to be generated e.g. when appending to a file. ] |