[LU-16] Allow objects larger than 2TB in size

• Type: Improvement
• Resolution: Fixed
• Priority: Minor
• Fix Version/s: Lustre 2.1.0
• Bugzilla ID: 20,128
• Assignee: Zhenyu Xu
• Reporter: Zhenyu Xu

Description

quote Andreas in bug 20128:

Current ext3 code limits the size of individual objects to 2TB. This assumption
has been hard-coded into the client by use of LUSTRE_STRIPE_MAXBYTES in
lov_alloc_memmd(). For ext4- and DMU-based OSTs this assumption is incorrect.

We need to be able to convey the maximum object size from the OST to the client
via obd_connect_data. This can be extracted from the OST superblock
sb->s_maxbytes and sent to clients that send a new OBD_CONNECT_MAXBYTES flag to
fill in an ocd_maxbytes field at connect time. The minimum of the per-OSC
maxbytes values should be used to determine the lov_maxbytes and lli_maxbytes.

Make sure not to conflict with any fields/flags in the obd_connect_data or
OBD_CONNECT between branches...

Issue Links

• is related to: LU-5979 RPC size compatibility code

Comments

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wirecheck.c
• lustre/include/lustre/lustre_idl.h
• lustre/utils/wiretest.c
• lustre/ptlrpc/wiretest.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wirecheck.c
• lustre/include/lustre/lustre_idl.h
• lustre/utils/wiretest.c
• lustre/ptlrpc/wiretest.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wirecheck.c
• lustre/utils/wiretest.c
• lustre/ptlrpc/wiretest.c
• lustre/include/lustre/lustre_idl.h

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wirecheck.c
• lustre/ptlrpc/wiretest.c
• lustre/include/lustre/lustre_idl.h
• lustre/utils/wiretest.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wirecheck.c
• lustre/ptlrpc/wiretest.c
• lustre/include/lustre/lustre_idl.h
• lustre/utils/wiretest.c

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/ptlrpc/wiretest.c
• lustre/utils/wiretest.c
• lustre/utils/wirecheck.c
• lustre/include/lustre/lustre_idl.h

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/include/lustre/lustre_idl.h
• lustre/utils/wirecheck.c
• lustre/utils/wiretest.c
• lustre/ptlrpc/wiretest.c

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wiretest.c
• lustre/ptlrpc/wiretest.c
• lustre/utils/wirecheck.c
• lustre/include/lustre/lustre_idl.h

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #376
LU-16 idl: fix obd_connect_data padding comments (Revision 20aee71e3b66eb183cddef7a018887078027b815)

Result = SUCCESS
Oleg Drokin : 20aee71e3b66eb183cddef7a018887078027b815
Files :

• lustre/utils/wirecheck.c
• lustre/include/lustre/lustre_idl.h
• lustre/ptlrpc/wiretest.c
• lustre/utils/wiretest.c