[LU-143] hash function of ldlm_namespace and lu_site is not good enough

• Type: Improvement
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.2.0, Lustre 2.1.2
• Affects Version/s: Lustre 2.1.0
• Assignee: Liang Zhen (Inactive)
• Reporter: Liang Zhen (Inactive)

Description

After turning on CFS_HASH_DEBUG_2, we can see hundreds or more traveling on list of these hash-tables if one single client create/stat/unlink millions of files under a single directory, which is bad for performance.
I've worked out a patch to improve the hash function, will post for review very soon.

Issue Links

• Trackbacks: Changelog 2.1 Changes from version 2.1.1 to version 2.1.2 Server support for kernels: 2.6.18308.4.1.el5 (RHEL5) 2.6.32220.17.1.el6 (RHEL6) Client support for unpatched kernels: 2.6.18308.4.1.el5 (RHEL5) 2.6.32220.17.1....
• Trackbacks: Changelog 2.2 version 2.2.0 Support for networks: o2iblnd OFED 1.5.4 Server support for kernels: 2.6.32220.4.2.el6 (RHEL6) Client support for unpatched kernels: 2.6.18274.18.1.el5 (RHEL5) 2.6.32220.4.2.el6 (RHEL6) 2.6.32.360....

Comments

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• libcfs/libcfs/hash.c
• lustre/ldlm/ldlm_resource.c
• lustre/obdclass/lu_object.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/ldlm/ldlm_resource.c
• libcfs/libcfs/hash.c
• lustre/obdclass/lu_object.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/obdclass/lu_object.c
• lustre/ldlm/ldlm_resource.c
• libcfs/libcfs/hash.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = FAILURE
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/obdclass/lu_object.c
• libcfs/libcfs/hash.c
• lustre/ldlm/ldlm_resource.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/obdclass/lu_object.c
• lustre/ldlm/ldlm_resource.c
• libcfs/libcfs/hash.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/ldlm/ldlm_resource.c
• lustre/obdclass/lu_object.c
• libcfs/libcfs/hash.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• libcfs/libcfs/hash.c
• lustre/obdclass/lu_object.c
• lustre/ldlm/ldlm_resource.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/obdclass/lu_object.c
• libcfs/libcfs/hash.c
• lustre/ldlm/ldlm_resource.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/obdclass/lu_object.c
• libcfs/libcfs/hash.c
• lustre/ldlm/ldlm_resource.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #378
LU-143 fid hash improvements (Revision 23d5254c8d607a0ae1065853011ecfc82f0543a2)

Result = SUCCESS
Oleg Drokin : 23d5254c8d607a0ae1065853011ecfc82f0543a2
Files :

• lustre/ldlm/ldlm_resource.c
• libcfs/libcfs/hash.c
• lustre/obdclass/lu_object.c