[LU-12807] runtests test 1 fails with ''Space not all freed: now 180500kB, was 180424kB.''

• Type: Bug
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.15.0
• Affects Version/s: Lustre 2.13.0, Lustre 2.14.0
• Severity: 3
• Assignee: Andreas Dilger
• Reporter: James Nunez (Inactive)

Description

runtests test_1 fails for ldiskfs testing with ''Space not all freed: now 180500kB, was 180424kB.'' The last lines in the client test_log are

Waiting for local destroys to complete
 runtests test_1: @@@@@@ FAIL: Space not all freed: now 180500kB, was 180424kB. 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:6119:error()
  = /usr/lib64/lustre/tests/runtests:132:test_1()

In the past , we’ve had issues with this test failing in this way for ZFS; see LU-12579. The last ZFS failure we saw was on 12-SEPT-2019.
This issue started on 17-SEPT-2019 for ldiskfs. We see this test fail mostly in full and full-patchless testing and rarely does it fail in review/patch testing.

Patch https://review.whamcloud.com/#/c/36011/ for LU-12579 landed about the time these tests started failing. The patch modifies the runtests test 1 the difference it will allow on the amount of space used before calling the test a failure

 131 if [ $(expr $NOWUSED - $USED) -gt $(fs_log_size) ]; then
 132         error "Space not all freed: now ${NOWUSED}kB, was ${USED}kB."
 133 else
 134         log "Space was freed: now ${NOWUSED}kB, was ${USED}kB."
 135 fi
 136 }

Prior to the patch, the allowed value of used space was 1024 Kbytes. For ldiskfs, using the fs_log_size() function, it is 50 Kbytes. This value may be too restrictive for ldiskfs in full/full-patchless testing.

Logs for more of these failures are at
https://testing.whamcloud.com/test_sets/cba207a4-dc46-11e9-a197-52540065bddc
https://testing.whamcloud.com/test_sets/67b1c4ce-dc59-11e9-b62b-52540065bddc
https://testing.whamcloud.com/test_sets/b530f9e0-dcc7-11e9-b62b-52540065bddc
https://testing.whamcloud.com/test_sets/8afc04d6-d9e2-11e9-a2b6-52540065bddc

Issue Links

• is related to: LU-15740 runtests test_1: 'Space not all freed