imperative recovery (LU-19)

[LU-571] Remove Parallel AST limits Created: 05/Aug/11  Updated: 20/Jan/12  Resolved: 20/Jan/12

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.2.0

Type: Technical task Priority: Minor
Reporter: Jinshan Xiong (Inactive) Assignee: Jinshan Xiong (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Rank (Obsolete): 4795

 Description   

Imperative recovery has to notify the clients as soon as possible. However, the limitation of parallel ast is set to 200 each time, this causes a problem for IR since it will take:

(# of client) * (AST_RPC_TIMEOUT) / 200

at most for the MGS to notify all clients, and the recovery time window may have passed this will cause all clients will be evicted.

 Comments   
Comment by Jinshan Xiong (Inactive) [ 05/Aug/11 ]

patch is at: http://review.whamcloud.com/1190

Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,client,sles11,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_internal.h
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » i686,server,el6,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_plain.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,server,el5,ofa #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_internal.h
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » i686,client,el6,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_inodebits.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_flock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_extent.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,client,el6,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_lock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_flock.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,server,el5,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_flock.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_inodebits.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » i686,server,el5,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_flock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_inodebits.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,client,el5,ofa #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_flock.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,client,el5,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_internal.h
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » x86_64,server,el6,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/include/lustre_dlm.h
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » i686,client,el5,ofa #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_flock.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » i686,client,el5,inkernel #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lockd.c
Comment by Build Master (Inactive) [ 03/Oct/11 ]

Integrated in lustre-master » i686,server,el5,ofa #285
LU-571 ldlm: Remove parallel AST limitation

Oleg Drokin : 8c83e7d75989ef527e43a824a0dbe46bffabd07d
Files :

  • lustre/ldlm/ldlm_extent.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_flock.c
  • lustre/ldlm/ldlm_inodebits.c
  • lustre/ldlm/ldlm_plain.c
  • lustre/ldlm/ldlm_resource.c
Comment by Vitaly Fertman [ 26/Oct/11 ]

this solution does not look scalable.
if you need to cancel 1M of conflicting locks, you need to allocate 1M of requests at once.
if you are low on memory if may be a problem.

Comment by Jinshan Xiong (Inactive) [ 26/Oct/11 ]

yes, I'll fix it with vs patch on bug 24450.

Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,server,el5,ofa #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lockd.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,client,sles11,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/include/lustre_dlm.h
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,client,el5,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lock.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,client,el5,ofa #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_internal.h
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lock.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,server,el5,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_internal.h
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,client,el6,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/include/lustre_dlm.h
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » i686,client,el6,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_lock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_internal.h
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » i686,server,el5,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_lock.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_internal.h
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » i686,server,el5,ofa #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » i686,client,el5,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_lock.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » i686,client,el5,ofa #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lock.c
Comment by Build Master (Inactive) [ 03/Jan/12 ]

Integrated in lustre-master » i686,server,el6,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_resource.c
  • lustre/ldlm/ldlm_lockd.c
  • lustre/ldlm/ldlm_internal.h
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_lock.c
Comment by Build Master (Inactive) [ 04/Jan/12 ]

Integrated in lustre-master » x86_64,server,el6,inkernel #395
LU-571 ldlm: add parallel ast flow control (Revision 0bd27be7f20a671e7128f341a070838a2bd318dc)

Result = SUCCESS
Oleg Drokin : 0bd27be7f20a671e7128f341a070838a2bd318dc
Files :

  • lustre/ldlm/ldlm_lockd.c
  • lustre/include/lustre_dlm.h
  • lustre/ldlm/ldlm_internal.h
  • lustre/ldlm/ldlm_lock.c
  • lustre/ldlm/ldlm_resource.c
Generated at Sat Feb 10 01:08:20 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.