[LU-12495] sanity test_413b: subdirs shouldn't be evenly distributed Created: 30/Jun/19  Updated: 28/Sep/19  Resolved: 28/Sep/19

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.13.0
Fix Version/s: Lustre 2.13.0

Type: Bug Priority: Critical
Reporter: Maloo Assignee: Lai Siyao
Resolution: Fixed Votes: 0
Labels: None

Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

This issue was created by maloo for Andreas Dilger <adilger@whamcloud.com>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/ee0aa0ac-8e63-11e9-9f8d-52540065bddc

test_413b failed with the following error:

mkdir with roundrobin
lmv.lustre-clilmv-ffff9bf6dd522000.qos_threshold_rr=100
100 directories created on MDT0
100 directories created on MDT1
100 directories created on MDT2
100 directories created on MDT3
lmv.lustre-clilmv-ffff9bf6dd522000.qos_threshold_rr=17
MDT filesfree available: 286941 326868 284702 290743
Min free files: MDT2: 284702
Max free files: MDT1: 326868
striped dir -i2 -c1 /mnt/lustre/d413b.sanity-MDT2
Check for uneven MDTs: diff=42166 files (14%) must be > 10% ...ok
Don't need to fill MDT0
mkdir with balanced space usage
lmv.lustre-clilmv-ffff9ed5dae42000.qos_prio_free=100
99 directories created on MDT0
102 directories created on MDT1
98 directories created on MDT2
 sanity test_413b: @@@@@@ FAIL: subdirs shouldn't be evenly distributed 

<<Please provide additional information about the failure here>>

VVVVVVV DO NOT REMOVE LINES BELOW, Added by Maloo for auto-association VVVVVVV
sanity test_413b - subdirs shouldn't be evenly distributed



 Comments   
Comment by Andreas Dilger [ 30/Jun/19 ]

This is failing fairly regularly in autotest.

Comment by Lai Siyao [ 01/Jul/19 ]

Mmm, this looks to be test script issue, I'll update a patch soon.

Comment by Gerrit Updater [ 01/Jul/19 ]

Lai Siyao (lai.siyao@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/35394
Subject: LU-12495 libcfs: generate random u64 max correctly
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: aefb1848c8057183fe5106065add1595d06708e5

Comment by Gerrit Updater [ 01/Jul/19 ]

Lai Siyao (lai.siyao@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/35395
Subject: LU-12495 test: shorten qos_maxage to update statfs
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 24e9529642070b1455494e4d569d166b2bfa49b9

Comment by Andreas Dilger [ 06/Jul/19 ]

This is currently failing about 30% of all tests.

Comment by Gerrit Updater [ 07/Jul/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/35394/
Subject: LU-12495 obdclass: generate random u64 max correctly
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 645b72c5c0586e2183933ee52ad43d91c2eb3ad6

Comment by Gerrit Updater [ 12/Jul/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/35395/
Subject: LU-12495 test: shorten qos_maxage to update statfs
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 23cbeb6e31a77ea2face6fdd947aac5ad3c4e099

Comment by Peter Jones [ 12/Jul/19 ]

Landed for 2.13

Comment by James Nunez (Inactive) [ 17/Sep/19 ]

Reopening ticket because we are seeing this issue frequently. Logs for two recent failures are both for ZFS and are at:
https://testing.whamcloud.com/test_sets/8b5611d4-d739-11e9-9fc9-52540065bddc
https://testing.whamcloud.com/test_sets/97f6f2f8-d727-11e9-a2b6-52540065bddc

Comment by Gerrit Updater [ 23/Sep/19 ]

Lai Siyao (lai.siyao@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/36269
Subject: LU-12495 obdclass: qos penalties miscalculated
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: 4a66af0e4784007fc0999551b2a564af2a4dcfd1

Comment by Gerrit Updater [ 27/Sep/19 ]

Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/36269/
Subject: LU-12495 obdclass: qos penalties miscalculated
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: 9130d05de4e2b610095169b6f49a149c66444ee2

Comment by Peter Jones [ 28/Sep/19 ]

All landed now it seems

Generated at Sat Feb 10 02:53:05 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.