[LU-9566]  replay-single test_65a: @@@@@@ FAIL: No early reply Created: 27/May/17  Updated: 13/Mar/23

Status: Open
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.12.3, Lustre 2.12.4, Lustre 2.12.6, Lustre 2.12.7
Fix Version/s: None

Type: Bug Priority: Minor
Reporter: Hongchao Zhang Assignee: Hongchao Zhang
Resolution: Unresolved Votes: 0
Labels: ppc

Issue Links:
Duplicate
is duplicated by LU-3361 replay-single test_65a: @@@@@@ FAIL: ... Resolved
Related
is related to LU-14371 replay-single test 65b fails with 'No... Resolved
Severity: 3
Rank (Obsolete): 9223372036854775807

 Description   

stdout

== replay-single test 65a: AT: verify early replies ================================================== 11:07:04 (1473160024)
at_history=8
at_history=8
debug=other
fail_val=6000
fail_loc=0x8000050a
 replay-single test_65a: @@@@@@ FAIL: No early reply 
  Trace dump:
  = /usr/lib64/lustre/tests/test-framework.sh:4863:error()
  = /usr/lib64/lustre/tests/replay-single.sh:1701:test_65a()
  = /usr/lib64/lustre/tests/test-framework.sh:5123:run_one()
  = /usr/lib64/lustre/tests/test-framework.sh:5161:run_one_logged()
  = /usr/lib64/lustre/tests/test-framework.sh:4965:run_test()
  = /usr/lib64/lustre/tests/replay-single.sh:1708:main()
Dumping lctl log to /tmp/test_logs/1473160016/replay-single.test_65a.*.1473160052.log
fre1337: Warning: Permanently added 'fre1339,192.168.113.39' (ECDSA) to the list of known hosts.

fre1340: Warning: Permanently added 'fre1339,192.168.113.39' (ECDSA) to the list of known hosts.

fre1338: Warning: Permanently added 'fre1339,192.168.113.39' (ECDSA) to the list of known hosts.

debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck
debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck
debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck
debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck
Resetting fail_loc on all nodes...done.
FAIL 65a (29s)

cmd

SLOW=YES NAME=ncli mgs_HOST=fre1337 MGSDEV=/dev/vdb NETTYPE=tcp mds1_HOST=fre1337 MDSDEV1=/dev/vdc mds_HOST=fre1337 MDSDEV=/dev/vdc mds2_HOST=fre1337 MDSDEV2=/dev/vdd MDSCOUNT=2 ost1_HOST=fre1338 OSTDEV1=/dev/vdb ost2_HOST=fre1338 OSTDEV2=/dev/vdc OSTCOUNT=2 CLIENTS=fre1339 RCLIENTS="fre1340"   PDSH="/usr/bin/pdsh -R ssh -S -w " ONLY=65a MDS_MOUNT_OPTS="-o rw,user_xattr" OST_MOUNT_OPTS="-o user_xattr" MDSSIZE=0 OSTSIZE=0
  • Please note, this issue is seen while testing the patch of LU-8062 for SEA-101


 Comments   
Comment by Gerrit Updater [ 27/May/17 ]

Hongchao Zhang (hongchao.zhang@intel.com) uploaded a new patch: https://review.whamcloud.com/27318
Subject: LU-9566 test: intercept right requests
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: abf230649e9971ca9e578a791586fe7f4e31703e

Comment by Hongchao Zhang [ 25/Apr/18 ]

the patch has been rebased to the latest master

Comment by Patrick Farrell (Inactive) [ 28/Mar/19 ]

Hit on current master:
https://testing.whamcloud.com/test_sets/bb78e0f4-5173-11e9-a256-52540065bddc

Comment by Minh Diep [ 20/Aug/19 ]

+1 on b2_12: https://testing.whamcloud.com/test_sets/ff0c14c4-c2d1-11e9-97d5-52540065bddc

Comment by Li Xi [ 01/Sep/19 ]

+1 on PCC branch https://testing.whamcloud.com/test_sets/b89f02cc-cb4f-11e9-9fc9-52540065bddc

Comment by Sarah Liu [ 18/Oct/19 ]

on 2.12.3 PPC client https://testing.whamcloud.com/test_sets/ff7eba46-eb0e-11e9-b62b-52540065bddc

Comment by Emoly Liu [ 05/Feb/20 ]

+1 on master: https://testing.whamcloud.com/test_sets/e7c19366-476a-11ea-a1c8-52540065bddc

Comment by James Nunez (Inactive) [ 12/Jul/21 ]

Looking at failures over the past year, replay-single test_65a is still failing with the 'No early reply' message mostly for the b2_12 branch. When test 65a fails on other branches, it looks like there are many others replay-single tests that fail and there may be a different cause for the failures.

Looking at failures for the past year, here are a sample of test failures:

2.12.7 RC1 - https://testing.whamcloud.com/test_sets/4cf924bb-bfb3-4c60-ba5e-62121562e68d
2.12.6.69 ppc - https://testing.whamcloud.com/test_sets/d0f3af4d-d159-426b-8ad5-efe4412cf8b4
2.12.6.55 ppc - https://testing.whamcloud.com/test_sets/3ec45aa6-13ef-49f7-ac81-fe6a5105ef02
2.12.6.51 ppc - https://testing.whamcloud.com/test_sets/6885c8ec-74b6-44f7-8bf6-a83ba7c6ee0e
2.12.5.83 - https://testing.whamcloud.com/test_sets/7bc00870-4ba5-4421-9a05-e6b4e9766b61
2.12.5.60 ppc - https://testing.whamcloud.com/test_sets/ea3af64e-1750-477f-a939-3e8cf5e40474
2.12.5.32 ppc - https://testing.whamcloud.com/test_sets/98bc51af-75b0-4442-8d8a-561c13b2a108

Generated at Sat Feb 10 02:27:19 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.