[LU-10176] Data-on-MDT phase II

• Status: Open
• Project: Lustre
• Type: Epic
• Priority: Major
• Reporter: Mikhail Pershin
• Assignee: Mikhail Pershin
• Resolution: Unresolved
• Labels: DoM2

Sub-Tasks

Key	Summary	Type	Status	Assignee
LU-10175	DoM:Full support for the LDLM lock co...	Technical task	Resolved	Mikhail Pershin
LU-10177	DoM: manual migration MDT-OST	Technical task	Resolved	Mikhail Pershin
LU-10178	DoM: Use synced last BRW instead of e...	Technical task	Open	WC Triage
LU-10179	DoM: Data-on-MDT recovery cases	Technical task	Closed	Mikhail Pershin
LU-10180	DoM technical debts	Technical task	Resolved	Mikhail Pershin
LU-10181	DoM performance optimization	Technical task	Resolved	Mikhail Pershin
LU-10280	DoM cross-file open+readahead via sta...	Technical task	Open	WC Triage
LU-10289	DoM: add SHORTIO support for MDS RPCs	Technical task	Resolved	Mikhail Pershin
LU-10318	DoM: HSM support	Technical task	Resolved	Mikhail Pershin
LU-10664	DoM: make DoM lock enqueue non-blocking	Technical task	Resolved	Mikhail Pershin
LU-10665	DoM: append to file causes OST compon...	Technical task	Resolved	Mikhail Pershin
LU-10777	DoM performance is bad with FIO write	Technical task	Resolved	Mikhail Pershin
LU-10808	DoM: component end should align with ...	Technical task	Resolved	Mikhail Pershin
LU-10894	Compilebench results are lower than e...	Technical task	Resolved	Mikhail Pershin
LU-10895	better DOM+DNE intergation	Technical task	Closed	Mikhail Pershin
LU-11120	DoM Test Improvements - add compilebe...	Technical task	Resolved	Mikhail Pershin
LU-11121	DoM: mdt take discard lock at cleanup...	Technical task	Resolved	Mikhail Pershin
LU-11421	DoM: manual migration OST-MDT, MDT-MDT	Technical task	Resolved	Mikhail Pershin
LU-11427	Data on MDT performance tune	Technical task	Resolved	Jinshan Xiong
LU-11428	Writeback on close for DoM	Technical task	Open	Mikhail Pershin
LU-13415	DoM: keep optimizations even when OST...	Technical task	Resolved	Mikhail Pershin

• Key: Summary
• Summary: Type
• Type: Status
• Status: Assignee
• Epic Name: Data-on-MDT phase II

Description

Phase II development tasks for Data-on-MDT. It includes manual migration to/from MDT, various performance optimizations and all technical debts.

Issue Links

• is related to: LU-9341 PFL: append should not instantiate fu...
• is related to: LU-11421 DoM: manual migration OST-MDT, MDT-MDT
• is related to: LU-13612 efficient DoM->OST component migration
• is related to: LU-9627 Bad small-file behaviour even when lo...
• is related to: LU-3285 Data on MDT
• is related to: LU-10919 DoM: read data on stat() and readdir()
• is related to: LU-10995 DoM2: allow MDT-only filesystems
• is related to: LU-1757 Short I/O support
• is related to: LU-11285 don't stop on the first blocked lock ...
• is related to: LU-11425 Support quota for DoM
• is related to: LU-15010 grant shrink for MDTs

Comments

[Gerrit Updater]

Mike Pershin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/30085
Subject: LU-10176 tests: limit DoM tests to new servers only
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: c6d3b88133117abed5f87a7764bb4942b7f00924

[Joseph Gmitter (Inactive)]

Mike Pershin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/30059
Subject: LU-10176 tests: add FIO as test for DOM
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 7983be9af572433f24ceb4e3533b77866ec0e4e8

Moved to LU-10181 and landed there.

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/30085/
Subject: LU-10176 tests: limit DoM tests to new servers only
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 2f09984f3f332a9d13ed202b9a40e8195f28e33e

[Gerrit Updater]

Mike Pershin ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36903
Subject: LU-10176 dom: non-blocking enqueue for DOM locks
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 8141a37f520361c82196da0d6c1544855e43f235