[LU-957] LFSCK fix Object Index for MDT file-level backup/restore for lustre-2.x

• Type: New Feature
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.3.0
• Affects Version/s: Lustre 2.3.0
• Labels: LFSCK
• Story Points: 55

Epic

OI_Scrub

• Assignee: nasf (Inactive)
• Reporter: nasf (Inactive)

Description

Lustre-1.6 and Lustre-1.8 series support MDT file-level backup/restore. But such function does not work on Lustre-2.x yet. Because Lustre-2.x introduces Object Index (OI) file for global FID to MDT local identifier mapping, which is different from Lustre-1.6/1.8. Such OI file will become invalid after MDT file-level backup/restore.

This Phase I project will have LFSCK rebuild the OI file after MDT file-level backup/restore to make it workable as Lustre-1.6/1.8 series do.

Issue Links

• Trackbacks: Lustre Community Development in Progress Features are being developed for future Lustre releases both at Whamcloud and by other organizations in the Lustre community. These will be eligible for inclusion in future Lustre releases as per our processes

Comments

[Richard Henwood (Inactive)]

Demonstration Document

[nasf (Inactive)]

All patches have been landed to Lustre-2.3

[nasf (Inactive)]

Presentation for LFSCK phase I

[nasf (Inactive)]

In the patch http://review.whamcloud.com/#change,1910,set24, it has partly implemented rebuilding OI files from the case of remove-recreate, which much decrease the test time for large file set (at least 50% time saved). For those corner cases (some replay ops and NFS re-exported), will be processed in LU-1383 in the future.

[Build Master (Inactive)]

Integrated in lustre-reviews » i686,client,el5,inkernel #4624
LU-957 scrub: test scripts for OI scrub (Revision b8a5e136dbde105500926df29afbfdcb72f8ee23)

Result = SUCCESS
yong.fan : b8a5e136dbde105500926df29afbfdcb72f8ee23
Files :

• lustre/tests/Makefile.am
• lustre/tests/test-groups/regression
• lustre/tests/sanity-scrub.sh

[Build Master (Inactive)]

Integrated in lustre-reviews » x86_64,server,el5,inkernel #4624
LU-957 scrub: test scripts for OI scrub (Revision b8a5e136dbde105500926df29afbfdcb72f8ee23)

Result = SUCCESS
yong.fan : b8a5e136dbde105500926df29afbfdcb72f8ee23
Files :

• lustre/tests/sanity-scrub.sh
• lustre/tests/Makefile.am
• lustre/tests/test-groups/regression

[Build Master (Inactive)]

Integrated in lustre-reviews » i686,server,el6,inkernel #4624
LU-957 scrub: test scripts for OI scrub (Revision b8a5e136dbde105500926df29afbfdcb72f8ee23)

Result = SUCCESS
yong.fan : b8a5e136dbde105500926df29afbfdcb72f8ee23
Files :

• lustre/tests/test-groups/regression
• lustre/tests/Makefile.am
• lustre/tests/sanity-scrub.sh

[Build Master (Inactive)]

Integrated in lustre-reviews » x86_64,server,el6,inkernel #4624
LU-957 scrub: test scripts for OI scrub (Revision b8a5e136dbde105500926df29afbfdcb72f8ee23)

Result = SUCCESS
yong.fan : b8a5e136dbde105500926df29afbfdcb72f8ee23
Files :

• lustre/tests/sanity-scrub.sh
• lustre/tests/test-groups/regression
• lustre/tests/Makefile.am

[Build Master (Inactive)]

Integrated in lustre-reviews » i686,server,el5,inkernel #4624
LU-957 scrub: test scripts for OI scrub (Revision b8a5e136dbde105500926df29afbfdcb72f8ee23)

Result = SUCCESS
yong.fan : b8a5e136dbde105500926df29afbfdcb72f8ee23
Files :

• lustre/tests/sanity-scrub.sh
• lustre/tests/test-groups/regression
• lustre/tests/Makefile.am