[LU-16877] sanity: test_51d stripecount=3: OST 1 has more objects vs. OST 0 (327 > 249 x 5/4)'

• Type: Bug
• Resolution: Unresolved
• Priority: Minor
• Fix Version/s: Lustre 2.17.0
• Affects Version/s: Lustre 2.16.0
• Severity: 3
• Assignee: WC Triage
• Reporter: Maloo

Description

This issue was created by maloo for James Simmons <[e-mail]>

This issue relates to the following test suite run: https://testing.whamcloud.com/test_sets/325f9a5f-7560-46d2-95e3-f1fef70b0767

Test session details:
clients: https://build.whamcloud.com/job/lustre-reviews/95350 - 4.18.0-425.10.1.el8_7.x86_64
servers: https://build.whamcloud.com/job/lustre-reviews/95350 - 4.18.0-425.10.1.el8_lustre.x86_64

<<Please provide additional information about the failure here>>

Issue Links

• is duplicated by: LU-18894 sanity: 51d fails with unbalanced OST usage
• is related to: LU-16420 sanity test_51d: FAIL: stripecount=3: OST 1 has more objects vs. OST 0
• is related to: LU-12058 sanity test_51d: @@@@@@ FAIL: OST 1 has less #0 objects vs OST 0 (0 < 1000
• is related to: LU-16864 OST 1 has fewer objects vs. OST 0 (stripecount=3)

Comments

[Sergey Cheremencev]

+1 on master: https://testing.whamcloud.com/test_sets/03034613-b9e9-45ba-8151-9fccc06cb0d1

It says fewer, but I believe it is the same:

sanity test_51d: @@@@@@ FAIL: stripecount=3:  OST 1 has fewer #0 objects vs. OST 0  (88 < 143 x 4/6)  

[Zhenyu Xu]

+1 on master branch: https://testing.whamcloud.com/test_sets/56028c04-0976-48c1-b0a1-aeb726a2500d

[Jian Yu]

+1 on master branch: https://testing.whamcloud.com/test_sets/6bb3bff5-8612-4e6e-a103-206496f4149d

[Jian Yu]

Lustre 2.16.0 RC5: https://testing.whamcloud.com/test_sets/24fcf22b-6e7f-4896-8206-15b5b68684a8

[Arshad Hussain]

+1 on Master. https://testing.whamcloud.com/test_sets/325f9a5f-7560-46d2-95e3-f1fef70b0767

 

[...]

OST0 has 249 objects, 83 are index 0
OST1 has 327 objects, 157 are index 0
OST2 has 328 objects, 82 are index 0
OST3 has 328 objects, 82 are index 0
OST4 has 251 objects, 81 are index 0
OST5 has 328 objects, 160 are index 0
OST6 has 326 objects, 80 are index 0
OST7 has 327 objects, 83 are index 0
[...]
UUID                   1K-blocks        Used   Available Use% Mounted on
lustre-MDT0000_UUID      1160264       12056     1045012   2% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID      1160264        5976     1051092   1% /mnt/lustre[MDT:1]
lustre-MDT0002_UUID      1160264        3640     1053428   1% /mnt/lustre[MDT:2]
lustre-MDT0003_UUID      1160264        4128     1052940   1% /mnt/lustre[MDT:3]
lustre-OST0000_UUID      9226216       19232     8688008   1% /mnt/lustre[OST:0]
lustre-OST0001_UUID      9226216       14024     8693216   1% /mnt/lustre[OST:1]
lustre-OST0002_UUID      9226216        3444     8703796   1% /mnt/lustre[OST:2]
lustre-OST0003_UUID      9226216        3432     8703808   1% /mnt/lustre[OST:3]
lustre-OST0004_UUID      9226216        7576     8699664   1% /mnt/lustre[OST:4]
lustre-OST0005_UUID      9226216        7564     8699676   1% /mnt/lustre[OST:5]
lustre-OST0006_UUID      9226216        5468     8701772   1% /mnt/lustre[OST:6]
lustre-OST0007_UUID      9226216        5484     8701756   1% /mnt/lustre[OST:7]
filesystem_summary:     73809728       66224    69591696   1% /mnt/lustre
UUID                      Inodes       IUsed       IFree IUse% Mounted on
lustre-MDT0000_UUID       838864        2010      836854   1% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID       838864        1007      837857   1% /mnt/lustre[MDT:1]
lustre-MDT0002_UUID       838864        2382      836482   1% /mnt/lustre[MDT:2]
lustre-MDT0003_UUID       838864        1332      837532   1% /mnt/lustre[MDT:3]
lustre-OST0000_UUID       628320       19830      608490   4% /mnt/lustre[OST:0]
lustre-OST0001_UUID       628320       19886      608434   4% /mnt/lustre[OST:1]
lustre-OST0002_UUID       628320       19744      608576   4% /mnt/lustre[OST:2]
lustre-OST0003_UUID       628320       19714      608606   4% /mnt/lustre[OST:3]
lustre-OST0004_UUID       628320       19711      608609   4% /mnt/lustre[OST:4]
lustre-OST0005_UUID       628320       19775      608545   4% /mnt/lustre[OST:5]
lustre-OST0006_UUID       628320       19709      608611   4% /mnt/lustre[OST:6]
lustre-OST0007_UUID       628320       19704      608616   4% /mnt/lustre[OST:7]
filesystem_summary:      3355456        6731     3348725   1% /mnt/lustre
 sanity test_51d: @@@@@@ FAIL: stripecount=3:  OST 1 has more objects vs. OST 0  (327 > 249 x 5/4) 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:6585:error()
  = /usr/lib64/lustre/tests/sanity.sh:6054:test_51d_sub()
  = /usr/lib64/lustre/tests/sanity.sh:6111:test_51d()
  = /usr/lib64/lustre/tests/test-framework.sh:6925:run_one()
  = /usr/lib64/lustre/tests/test-framework.sh:6974:run_one_logged()
  = /usr/lib64/lustre/tests/test-framework.sh:6811:run_test()
  = /usr/lib64/lustre/tests/sanity.sh:6114:main()
 [...]

 
 

[Qian Yingjin]

+1 on master: https://testing.whamcloud.com/test_sets/c97b993e-5559-43b7-a3d6-219e41c2c9c0

[Serguei Smirnov]

+1 on master: https://testing.whamcloud.com/test_sets/201d9543-494a-49c4-a8e0-87e383b8dd86