[LU-4556] speed up sanity-lfsck and sanity-scrub tests

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.6.0
• Fix Version/s: Lustre 2.6.0
• Type: Technical task
• Priority: Major
• Reporter: Andreas Dilger
• Assignee: nasf (Inactive)
• Resolution: Fixed
• Labels: improvement

Description

The test time of sanity-scrub and sanity-lfsck is much longer than it needs to be, especially in DNE mode, because it is reformatting all of the OSTs and MDTs for every test, and then repopulating the filesystem with test files.

It would be better to avoid reformatting the filesystems at all, and instead just compare the "new" results with the "old" results.

There may be other potential areas of improvement also.

Issue Links

• duplicates: LU-4686 Try to NOT reformat the device in LFS...
• is related to: LU-4202 Test failure sanity-lfsck test_8: Exp...
• is related to: LU-4537 Track slow tests in review-dne
• is related to: LU-5112 Interop 2.5 server with higher versio...
• is related to: LU-4763 sanity-scrub test 11: FAIL: (8) Expec...

Comments

[nasf (Inactive)]

New version sanity-lfsck takes about 750 seconds under DNE mode in my local VM environment. New version sanity-scrub is still in testing.

[nasf (Inactive)]

Here is the patch:

http://review.whamcloud.com/9704

[nasf (Inactive)]

Sometimes, create on Maloo is very slow, less than 50 objects/sec, no logs, very strange.
sanity-scrub in my local environment (with 2 MDT and 2 OST) takes about 770 second.

[nasf (Inactive)]

It is very important to reduce the Maloo tests run time.

[Andreas Dilger]

While this is useful to fix, it would not block the release of 2.6.0 so reducing the priority. I'm happy that some good improvements have been made with the current patch, and would prefer that effort be focussed on fixing defects for 2.6.

[nasf (Inactive)]

The patch has been landed to master.