[LU-5] Multiple pages for large readdir RPCs Created: 30/Sep/10  Updated: 21/Oct/11  Resolved: 21/Oct/11

Status: Resolved
Project: Lustre
Component/s: None
Affects Version/s: None
Fix Version/s: Lustre 2.1.0

Type: Improvement Priority: Major
Reporter: Robert Read (Inactive) Assignee: Lai Siyao
Resolution: Fixed Votes: 0
Labels: None

Bugzilla ID: 17,833
Rank (Obsolete): 4956

 Description   

This is WC tracking bug for 17833.

 Comments   
Comment by Lai Siyao [ 06/Nov/10 ]

Patches are ready for inspection.

Comment by Lai Siyao [ 19/Nov/10 ]

Inspection is going on. Answered several comments.

Comment by Lai Siyao [ 28/Nov/10 ]

Updated patches according to comments from Andreas.

Comment by Lai Siyao [ 05/Dec/10 ]

Internal inspections finished, wait for result from Andreas and Vitaly.

Comment by Andreas Dilger [ 18/May/11 ]

Lai, can you please move the patches from bugzilla over to Gerrit for inspection, testing, and landing.

Comment by Lai Siyao [ 18/May/11 ]

Okay. Andreas, is it for 2.x only?

Comment by Andreas Dilger [ 19/May/11 ]

The feature only needs to be implemented for 2.x, but it (like every other feature) needs to interoperate with 1.8 clients. That means 1.8 and 2.[01] clients doing single-page readdirs need to continue working, and 2.2 clients (where I expect this to be landed) can detect whether the MDS is able to handle large readdir requests via OBD_CONNECT_BRW_SIZE return value.

Comment by Lai Siyao [ 13/Jun/11 ]

Review is on http://review.whamcloud.com/#change,604

Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,client,el5,ofa #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/llite/dir.c
  • lustre/llite/llite_lib.c
  • lustre/lmv/lmv_obd.c
  • lustre/osc/lproc_osc.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/osc/osc_request.c
  • lustre/llite/llite_internal.h
  • lustre/include/md_object.h
  • lustre/include/lustre_lib.h
  • lustre/mdd/mdd_object.c
  • lustre/tests/sanity.sh
  • lustre/include/lprocfs_status.h
  • lustre/osc/osc_internal.h
  • lustre/include/lustre/lustre_idl.h
  • lustre/liblustre/dir.c
  • lustre/cmm/mdc_device.c
  • lustre/ptlrpc/import.c
  • lustre/include/obd.h
  • lustre/autoconf/lustre-core.m4
  • lustre/mdt/mdt_handler.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/mdc/lproc_mdc.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/utils/wirecheck.c
  • lustre/include/obd_class.h
  • lustre/ost/ost_handler.c
  • lustre/mdc/mdc_request.c
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,client,el5,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/osc/osc_request.c
  • lustre/tests/sanity.sh
  • lustre/llite/dir.c
  • lustre/liblustre/dir.c
  • lustre/include/lustre/lustre_idl.h
  • lustre/osc/osc_internal.h
  • lustre/include/obd_class.h
  • lustre/include/md_object.h
  • lustre/ost/ost_handler.c
  • lustre/mdc/lproc_mdc.c
  • lustre/mdd/mdd_object.c
  • lustre/lmv/lmv_obd.c
  • lustre/llite/llite_internal.h
  • lustre/mdt/mdt_handler.c
  • lustre/cmm/mdc_device.c
  • lustre/llite/llite_lib.c
  • lustre/mdc/mdc_request.c
  • lustre/include/lprocfs_status.h
  • lustre/utils/wirecheck.c
  • lustre/include/obd.h
  • lustre/osc/lproc_osc.c
  • lustre/ptlrpc/import.c
  • lustre/autoconf/lustre-core.m4
  • lustre/include/lustre_lib.h
  • lustre/ldlm/ldlm_lib.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/include/linux/lustre_compat25.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,client,sles11,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/obdclass/lprocfs_status.c
  • lustre/include/lustre_lib.h
  • lustre/mdt/mdt_handler.c
  • lustre/ost/ost_handler.c
  • lustre/autoconf/lustre-core.m4
  • lustre/ldlm/ldlm_lib.c
  • lustre/ptlrpc/import.c
  • lustre/osc/lproc_osc.c
  • lustre/llite/llite_lib.c
  • lustre/tests/sanity.sh
  • lustre/include/lustre/lustre_idl.h
  • lustre/include/obd.h
  • lustre/lmv/lmv_obd.c
  • lustre/include/obd_class.h
  • lustre/cmm/mdc_device.c
  • lustre/osc/osc_request.c
  • lustre/mdc/mdc_request.c
  • lustre/include/md_object.h
  • lustre/llite/dir.c
  • lustre/include/lprocfs_status.h
  • lustre/llite/llite_internal.h
  • lustre/mdc/lproc_mdc.c
  • lustre/osc/osc_internal.h
  • lustre/liblustre/dir.c
  • lustre/utils/wirecheck.c
  • lustre/mdd/mdd_object.c
  • lustre/include/linux/lustre_compat25.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,server,el5,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/llite/llite_lib.c
  • lustre/lmv/lmv_obd.c
  • lustre/include/lustre_lib.h
  • lustre/mdc/mdc_request.c
  • lustre/autoconf/lustre-core.m4
  • lustre/include/obd_class.h
  • lustre/mdc/lproc_mdc.c
  • lustre/cmm/mdc_device.c
  • lustre/osc/osc_internal.h
  • lustre/mdd/mdd_object.c
  • lustre/include/md_object.h
  • lustre/ptlrpc/import.c
  • lustre/include/lprocfs_status.h
  • lustre/include/obd.h
  • lustre/mdt/mdt_handler.c
  • lustre/osc/osc_request.c
  • lustre/utils/wirecheck.c
  • lustre/ost/ost_handler.c
  • lustre/liblustre/dir.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/llite/llite_internal.h
  • lustre/llite/dir.c
  • lustre/include/lustre/lustre_idl.h
  • lustre/include/linux/lustre_compat25.h
  • lustre/osc/lproc_osc.c
  • lustre/tests/sanity.sh
  • lustre/ldlm/ldlm_lib.c
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » i686,client,el6,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/osc/lproc_osc.c
  • lustre/tests/sanity.sh
  • lustre/include/md_object.h
  • lustre/liblustre/dir.c
  • lustre/llite/llite_internal.h
  • lustre/include/lustre_lib.h
  • lustre/include/lustre/lustre_idl.h
  • lustre/obdclass/lprocfs_status.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/ptlrpc/import.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/include/obd_class.h
  • lustre/llite/llite_lib.c
  • lustre/mdt/mdt_handler.c
  • lustre/ost/ost_handler.c
  • lustre/llite/dir.c
  • lustre/include/obd.h
  • lustre/mdd/mdd_object.c
  • lustre/osc/osc_request.c
  • lustre/autoconf/lustre-core.m4
  • lustre/osc/osc_internal.h
  • lustre/cmm/mdc_device.c
  • lustre/mdc/lproc_mdc.c
  • lustre/utils/wirecheck.c
  • lustre/lmv/lmv_obd.c
  • lustre/mdc/mdc_request.c
  • lustre/include/lprocfs_status.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,server,el5,ofa #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/include/md_object.h
  • lustre/mdd/mdd_object.c
  • lustre/llite/llite_lib.c
  • lustre/include/obd.h
  • lustre/lmv/lmv_obd.c
  • lustre/tests/sanity.sh
  • lustre/include/lustre_lib.h
  • lustre/liblustre/dir.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/ost/ost_handler.c
  • lustre/utils/wirecheck.c
  • lustre/mdc/mdc_request.c
  • lustre/osc/osc_internal.h
  • lustre/include/lustre/lustre_idl.h
  • lustre/ldlm/ldlm_lib.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/autoconf/lustre-core.m4
  • lustre/osc/lproc_osc.c
  • lustre/llite/dir.c
  • lustre/include/lprocfs_status.h
  • lustre/llite/llite_internal.h
  • lustre/osc/osc_request.c
  • lustre/mdt/mdt_handler.c
  • lustre/include/obd_class.h
  • lustre/mdc/lproc_mdc.c
  • lustre/ptlrpc/import.c
  • lustre/cmm/mdc_device.c
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/mdc/mdc_request.c
  • lustre/include/obd_class.h
  • lustre/osc/lproc_osc.c
  • lustre/utils/wirecheck.c
  • lustre/llite/llite_internal.h
  • lustre/ptlrpc/import.c
  • lustre/mdd/mdd_object.c
  • lustre/include/lustre_lib.h
  • lustre/obdclass/lprocfs_status.c
  • lustre/llite/dir.c
  • lustre/osc/osc_request.c
  • lustre/osc/osc_internal.h
  • lustre/include/obd.h
  • lustre/autoconf/lustre-core.m4
  • lustre/cmm/mdc_device.c
  • lustre/include/lprocfs_status.h
  • lustre/ost/ost_handler.c
  • lustre/mdc/lproc_mdc.c
  • lustre/tests/sanity.sh
  • lustre/include/lustre/lustre_idl.h
  • lustre/mdt/mdt_handler.c
  • lustre/include/md_object.h
  • lustre/liblustre/dir.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/lmv/lmv_obd.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/llite/llite_lib.c
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » i686,server,el5,ofa #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/utils/wirecheck.c
  • lustre/osc/osc_internal.h
  • lustre/osc/lproc_osc.c
  • lustre/llite/dir.c
  • lustre/include/lprocfs_status.h
  • lustre/cmm/mdc_device.c
  • lustre/mdc/mdc_request.c
  • lustre/osc/osc_request.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/lmv/lmv_obd.c
  • lustre/include/obd_class.h
  • lustre/llite/llite_lib.c
  • lustre/mdd/mdd_object.c
  • lustre/include/obd.h
  • lustre/ptlrpc/import.c
  • lustre/mdt/mdt_handler.c
  • lustre/mdc/lproc_mdc.c
  • lustre/include/lustre_lib.h
  • lustre/tests/sanity.sh
  • lustre/llite/llite_internal.h
  • lustre/ost/ost_handler.c
  • lustre/autoconf/lustre-core.m4
  • lustre/include/md_object.h
  • lustre/obdclass/lprocfs_status.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/liblustre/dir.c
  • lustre/include/lustre/lustre_idl.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » i686,server,el5,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/include/lustre_lib.h
  • lustre/include/linux/lustre_compat25.h
  • lustre/liblustre/dir.c
  • lustre/autoconf/lustre-core.m4
  • lustre/ost/ost_handler.c
  • lustre/llite/llite_lib.c
  • lustre/include/md_object.h
  • lustre/obdclass/lprocfs_status.c
  • lustre/utils/wirecheck.c
  • lustre/include/obd_class.h
  • lustre/mdd/mdd_object.c
  • lustre/llite/dir.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/osc/osc_request.c
  • lustre/include/lprocfs_status.h
  • lustre/mdc/lproc_mdc.c
  • lustre/osc/lproc_osc.c
  • lustre/ptlrpc/import.c
  • lustre/tests/sanity.sh
  • lustre/include/lustre/lustre_idl.h
  • lustre/mdc/mdc_request.c
  • lustre/lmv/lmv_obd.c
  • lustre/osc/osc_internal.h
  • lustre/mdt/mdt_handler.c
  • lustre/cmm/mdc_device.c
  • lustre/llite/llite_internal.h
  • lustre/include/obd.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » i686,server,el6,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/llite/llite_internal.h
  • lustre/osc/lproc_osc.c
  • lustre/ptlrpc/import.c
  • lustre/include/md_object.h
  • lustre/include/lustre_lib.h
  • lustre/osc/osc_internal.h
  • lustre/include/lustre/lustre_idl.h
  • lustre/mdt/mdt_handler.c
  • lustre/include/obd.h
  • lustre/mdd/mdd_object.c
  • lustre/mdc/mdc_request.c
  • lustre/liblustre/dir.c
  • lustre/ost/ost_handler.c
  • lustre/tests/sanity.sh
  • lustre/utils/wirecheck.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/osc/osc_request.c
  • lustre/autoconf/lustre-core.m4
  • lustre/mdc/lproc_mdc.c
  • lustre/include/obd_class.h
  • lustre/include/lprocfs_status.h
  • lustre/cmm/mdc_device.c
  • lustre/llite/llite_lib.c
  • lustre/llite/dir.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/lmv/lmv_obd.c
  • lustre/obdclass/lprocfs_status.c
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » i686,client,el5,ofa #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/ost/ost_handler.c
  • lustre/include/lprocfs_status.h
  • lustre/lmv/lmv_obd.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/llite/dir.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/mdc/mdc_request.c
  • lustre/osc/lproc_osc.c
  • lustre/liblustre/dir.c
  • lustre/include/lustre/lustre_idl.h
  • lustre/llite/llite_lib.c
  • lustre/include/obd_class.h
  • lustre/autoconf/lustre-core.m4
  • lustre/ptlrpc/import.c
  • lustre/include/lustre_lib.h
  • lustre/osc/osc_request.c
  • lustre/tests/sanity.sh
  • lustre/osc/osc_internal.h
  • lustre/mdd/mdd_object.c
  • lustre/llite/llite_internal.h
  • lustre/utils/wirecheck.c
  • lustre/cmm/mdc_device.c
  • lustre/mdt/mdt_handler.c
  • lustre/mdc/lproc_mdc.c
  • lustre/include/obd.h
  • lustre/include/md_object.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » i686,client,el5,inkernel #208
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/include/obd_class.h
  • lustre/include/md_object.h
  • lustre/mdc/mdc_request.c
  • lustre/osc/lproc_osc.c
  • lustre/cmm/mdc_device.c
  • lustre/ptlrpc/import.c
  • lustre/lmv/lmv_obd.c
  • lustre/ost/ost_handler.c
  • lustre/include/obd.h
  • lustre/llite/llite_lib.c
  • lustre/include/linux/lustre_compat25.h
  • lustre/mdd/mdd_object.c
  • lustre/mdc/lproc_mdc.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/utils/wirecheck.c
  • lustre/include/lustre_lib.h
  • lustre/llite/llite_internal.h
  • lustre/include/lprocfs_status.h
  • lustre/autoconf/lustre-core.m4
  • lustre/mdt/mdt_handler.c
  • lustre/liblustre/dir.c
  • lustre/include/lustre/lustre_idl.h
  • lustre/tests/sanity.sh
  • lustre/ldlm/ldlm_lib.c
  • lustre/llite/dir.c
  • lustre/osc/osc_request.c
  • lustre/osc/osc_internal.h
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,server,el6,inkernel #209
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/osc/osc_internal.h
  • lustre/include/md_object.h
  • lustre/lmv/lmv_obd.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/ost/ost_handler.c
  • lustre/utils/wirecheck.c
  • lustre/llite/llite_internal.h
  • lustre/liblustre/dir.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/ptlrpc/import.c
  • lustre/mdc/lproc_mdc.c
  • lustre/include/obd.h
  • lustre/include/linux/lustre_compat25.h
  • lustre/include/obd_class.h
  • lustre/include/lustre/lustre_idl.h
  • lustre/tests/sanity.sh
  • lustre/mdt/mdt_handler.c
  • lustre/llite/llite_lib.c
  • lustre/include/lprocfs_status.h
  • lustre/mdc/mdc_request.c
  • lustre/osc/lproc_osc.c
  • lustre/include/lustre_lib.h
  • lustre/cmm/mdc_device.c
  • lustre/autoconf/lustre-core.m4
  • lustre/mdd/mdd_object.c
  • lustre/osc/osc_request.c
  • lustre/llite/dir.c
Comment by Build Master (Inactive) [ 14/Jul/11 ]

Integrated in lustre-master » x86_64,client,el6,inkernel #209
LU-5 readdir read multiple pages per rpc

Oleg Drokin : 58f3eb928f563f24f0b3ee41970fa23a59fdcb87
Files :

  • lustre/llite/llite_internal.h
  • lustre/include/obd_class.h
  • lustre/cmm/mdc_device.c
  • lustre/ldlm/ldlm_lib.c
  • lustre/llite/llite_lib.c
  • lustre/lmv/lmv_obd.c
  • lustre/include/md_object.h
  • lustre/liblustre/dir.c
  • lustre/mdc/mdc_request.c
  • lustre/osc/lproc_osc.c
  • lustre/mdt/mdt_handler.c
  • lustre/obdclass/lprocfs_status.c
  • lustre/utils/wirecheck.c
  • lustre/include/obd.h
  • lustre/ptlrpc/import.c
  • lustre/llite/dir.c
  • lustre/osc/osc_internal.h
  • lustre/include/lustre/lustre_idl.h
  • lustre/autoconf/lustre-core.m4
  • lustre/tests/sanity.sh
  • lustre/include/lustre_lib.h
  • lustre/include/lprocfs_status.h
  • lustre/osc/osc_request.c
  • lustre/mdc/lproc_mdc.c
  • lustre/mdd/mdd_object.c
  • lustre/ost/ost_handler.c
  • lustre/include/linux/lustre_compat25.h
Comment by Andreas Dilger [ 21/Oct/11 ]

Is there anything left in this bug, or can it be closed?

Comment by Lai Siyao [ 21/Oct/11 ]

This can be closed.

Generated at Sat Feb 10 01:02:47 UTC 2024 using Jira 9.4.14#940014-sha1:734e6822bbf0d45eff9af51f82432957f73aa32c.