[LU-1098] Object doesn't exist! Created: 13/Feb/12  Updated: 03/May/12  Resolved: 23/Feb/12

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: Lustre 2.2.0
Fix Version/s: Lustre 2.2.0, Lustre 2.1.2

Type: Bug Priority: Blocker
Reporter: Christopher Morrone Assignee: Zhenyu Xu
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Duplicate
duplicates LU-966 post-fsck MDS LBUG during recovery du... Resolved
is duplicated by LU-1350 Parent doesn't exist! Resolved
Severity: 3
Rank (Obsolete): 4713

 Description   

One one of our MDS nodes, we see a pretty voluminous stream of "Object doesn't exist" messages from the mdt_getattr_name_lock() function, and the associated LU_OBJECT_DEBUG output.

We looked at code briefly and suspect that this is a race between an unlink and a getattr, which would be completely normal and expected.

So why does this message exist? Is the race being handled correctly?

 Comments   
Comment by Christopher Morrone [ 13/Feb/12 ]

Err, sorry, this is with 2.1.0-21chaos.

Comment by Andreas Dilger [ 13/Feb/12 ]

This looks to be a duplicate of LU-966 (http://review.whamcloud.com/1928), which was fixed for the 2.2 release.

Comment by Andreas Dilger [ 13/Feb/12 ]

Assign to Bobijam to confirm. I think this is a duplicate of LU-966.

Comment by Christopher Morrone [ 13/Feb/12 ]

There isn't a lot of info in LU-966. Our problem, at least, is not a start-up issue, and to the best of my knowledge no objects were removed during fsck.

Comment by Andreas Dilger [ 13/Feb/12 ]

I agree that the information in LU-966 and change 1928 are too sparse for my liking. Looking at the patch in 1928 it appears to be changing the code to allow "missing" objects in a number of places, and in particular deletes the "Object doesn't exist" message entirely.

Hopefully Bobijam will be able to determine if your problem would be fixed by that patch.

Comment by Zhenyu Xu [ 13/Feb/12 ]

yes, that's normal unlink/delete race, and we check mdt objects existence before trying to lock them.

Change #1928 does not quench these warning messages, even worse it raises them to D_ERROR level, I think we should issue warning/error debug logs only at necessary places.

Comment by Zhenyu Xu [ 14/Feb/12 ]

patch tracking at http://review.whamcloud.com/2143

Comment by Peter Jones [ 20/Feb/12 ]

Has this now become a duplicate of LU-1017?

Comment by Zhenyu Xu [ 20/Feb/12 ]

no, still need lower the debug message level, patch tracking at http://review.whamcloud.com/2165

Comment by Peter Jones [ 23/Feb/12 ]

Landed for 2.2

Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,server,el5,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,server,el5,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,client,el5,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,client,el5,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,server,el5,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,client,sles11,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,client,el5,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,client,el5,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,server,el5,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Christopher Morrone [ 23/Feb/12 ]

I think that you forgot to keep the ChangeId the same on the patch. New gerrit entry is:

http://review.whamcloud.com/2165

It is possible that the stream of messages on the console was causing MDS issues, so this should probably land on 2.1 as well.

Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,server,el6,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,client,el6,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,client,el6,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,server,el6,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,server,el6,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » x86_64,client,el6,inkernel #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,server,el6,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 23/Feb/12 ]

Integrated in lustre-master » i686,client,el6,ofa #489
LU-1098 debug: lower debug message level (Revision cf2501b64acef9a57d3e4bb91fd3ba041b36388f)

Result = SUCCESS
Oleg Drokin : cf2501b64acef9a57d3e4bb91fd3ba041b36388f
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,client,sles11,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » i686,client,el6,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,server,el6,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » i686,client,el5,ofa #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,server,el5,ofa #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,client,el6,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » i686,server,el6,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,client,el5,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » i686,server,el5,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,server,el5,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » i686,server,el5,ofa #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » x86_64,client,el5,ofa #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Comment by Build Master (Inactive) [ 08/Apr/12 ]

Integrated in lustre-b2_1 » i686,client,el5,inkernel #41
LU-1098 debug: lower debug message level (Revision 826f7dc614b7623a9b11db84cf90140b5cf1498d)

Result = SUCCESS
Oleg Drokin : 826f7dc614b7623a9b11db84cf90140b5cf1498d
Files :

  • lustre/mdt/mdt_handler.c
Generated at Sat Feb 10 01:13:29 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.