[LU-12579] runtests: test_1: @@@@@@ FAIL: Space not all freed: now 309264kB, was 307632kB.

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.13.0
• Fix Version/s: Lustre 2.13.0, Lustre 2.12.9
• Type: Bug
• Priority: Blocker
• Reporter: Maloo
• Assignee: Andreas Dilger
• Resolution: Fixed
• Labels: zfs
• Severity: 3

Description

This issue was created by maloo for Chris Horn <[e-mail]>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/653f450e-acfc-11e9-a0be-52540065bddc

Comments

[Jian Yu]

This is a regression failure on master branch, which is affecting patch review testing.

[Andreas Dilger]

This is only being seen with ZFS, and only started on 2019-08-21:
https://testing.whamcloud.com/test_sets/6cbefd98-c448-11e9-a2b6-52540065bddc

There were a bunch of landings to master on that date, in particular patch https://review.whamcloud.com/34951 "LU-12336 build: Update ZFS version to 0.8.1" (previously ZFS 0.7.13 was used). It isn't clear if the missing space is a "leak" or if that just represents some internal ZFS data structure that is now being allocated that didn't previously exist and is normal behaviour? The sizes reported in test failures is usually the same (309264KB - 307632KB = 1632KB, but there was one failure (of 10 so far) that reported 35840KB - 32768KB = 3072KB.

One way to determine if this is a leak or not would be to run runtests several times in a row on the same filesystem, and see if each one is reporting a leak, or if that is only seen on the first one run? It appears that runtests is the first test run after the filesystem is formatted, so it may be that there is some space allocated when the filesystem is first used.

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36011
Subject: LU-12579 tests: check runtests for space leaks
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 29c4d1629f5b0fef4ac0e142cc3c2666deacaa6b

[James A Simmons]

Talking to Behlendorf he suspects its the addition of project quotas to ZFS for the 0.8.1 version. The additional space consumed is included with their stats.

[Gerrit Updater]

James Nunez ([e-mail]) uploaded a new patch: https://review.whamcloud.com/36138
Subject: LU-12579 tests: current test results baseline
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 4739183cf757a6919d64432203cf91485d14a94d

[Gerrit Updater]

Oleg Drokin ([e-mail]) merged in patch https://review.whamcloud.com/36011/
Subject: LU-12579 tests: allow some margin in runtests
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: c05656557353954b2a9799c4e702329db2d38851

[Peter Jones]

Landed for 2.13

[Gerrit Updater]

"James Nunez <[e-mail]>" uploaded a new patch: https://review.whamcloud.com/45579
Subject: LU-12579 tests: allow some margin in runtests
Project: fs/lustre-release
Branch: b2_12
Current Patch Set: 1
Commit: 5405bea3299439e955f1dd8d8b89a7e004f85889

[Gerrit Updater]

"Oleg Drokin <[e-mail]>" merged in patch https://review.whamcloud.com/45579/
Subject: LU-12579 tests: allow some margin in runtests
Project: fs/lustre-release
Branch: b2_12
Current Patch Set:
Commit: fac5c55ac3ec550030c0885e8449c823c983aad0