[LU-4256] lustre-rsync-test test_2b: Failure in replication; differences found

• Type: Bug
• Resolution: Unresolved
• Priority: Minor
• Affects Version/s: Lustre 2.6.0, Lustre 2.8.0, Lustre 2.12.0
• Labels: always_except
• Environment: server: lustre-master build # 1752 RHEL6 ldiskfs; client: 2.5.0 RHEL6 ldiskfs; ; Also seen in review-dne with both server and client are RHEL6 ldiskfs
• Severity: 3
• Assignee: WC Triage
• Reporter: Maloo

Description

This issue was created by maloo for sarah <[e-mail]>

This issue relates to the following test suite run: http://maloo.whamcloud.com/test_sets/45f323be-49e3-11e3-8efa-52540035b04c.

The sub-test test_2b failed with the following error:

test failed to respond and timed out

test log shows:

lustre_rsync took 22 seconds
Changelog records consumed: 926
Only in /mnt/lustre/d0.lustre-rsync-test/d2/clients/client0/~dmtmp/WORDPRO: BENCHS1A.PRN
 lustre-rsync-test test_2b: @@@@@@ FAIL: Failure in replication; differences found. 

Issue Links

• is duplicated by: LU-4978 Failure on test suite lustre-rsync-test test_2b: Failure in replication; differences found.
• is related to: LU-17361 lustre-rsync-test test_2a: Timeout occurred after 97 minutes, last suite running was lustre-rsync-test
• is related to: LU-4781 lustre-rsync-test test_2b: Replication of operation failed(-17)

Comments

[Saurabh Tandan (Inactive)]

Another instance found for interop tag 2.7.66 -2.5.5 Server/EL6.7 Client, build# 3316
https://testing.hpdd.intel.com/test_sets/2f54e8ae-ccf9-11e5-b1fa-5254006e85c2

[James Nunez (Inactive)]

A few more recent occurrences (non-interop, review-dne-part-1):
2015-07-21 03:39:41 - https://testing.hpdd.intel.com/test_sets/36ca7078-2f69-11e5-ad00-5254006e85c2
2015-07-21 14:18:36 - https://testing.hpdd.intel.com/test_sets/1ede63bc-2fc2-11e5-ad00-5254006e85c2
2015-10-25 19:49:39 - https://testing.hpdd.intel.com/test_sets/b915e5c6-7b5e-11e5-9ee6-5254006e85c2
2016-02-03 14:36:57 - https://testing.hpdd.intel.com/test_sets/d0a0de2c-ca90-11e5-9609-5254006e85c2

[Bob Glossman (Inactive)]

I think this is another:
https://testing.hpdd.intel.com/test_sets/3efa00dc-6fdf-11e4-85fc-5254006e85c2

It reports as a TIMEOUT, not a FAIL, but the test log says:

Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client1/~dmtmp/PARADOX: __QB4.MB
lustre-rsync-test test_2b: @@@@@@ FAIL: Failure in replication; differences found.

[nasf (Inactive)]

Another failure instance:

https://maloo.whamcloud.com/test_sets/24f9ee20-cc4e-11e3-bda1-52540035b04c

[Andreas Dilger]

This is related to, but looks different than, LU-4781. This bug just reports a replication difference, while LU-4781 reports errors during replication.

[Sarah Liu]

also seen in lustre-master build #1876
server: RHEL6 ldiskfs
client: SLES11 SP3 ldiskfs

https://maloo.whamcloud.com/test_sets/7edd3618-90d0-11e3-91ee-52540035b04c

[nasf (Inactive)]

I found the same failure under non interoperability mode.
https://maloo.whamcloud.com/test_sets/f0019a40-7682-11e3-bf7d-52540035b04c
https://maloo.whamcloud.com/test_sets/ec956efe-76a5-11e3-8c14-52540035b04c