[LU-363] Reduce the cached Kernel build artifacts to ease the use of disc space consumption.

• Status: Resolved
• Project: Lustre
• Affects Version/s: Lustre 2.1.0, Lustre 1.8.6
• Fix Version/s: Lustre 2.1.0, Lustre 1.8.6
• Type: Improvement
• Priority: Minor
• Reporter: Chris Gearing (Inactive)
• Assignee: Brian Murrell (Inactive)
• Resolution: Fixed

Description

Future builds don't actually need the %_topdir/BUILD subdir, and it's huge, we can stop caching it.

Comments

[Andreas Dilger]

Is there any mechanism to consolidate kernel builds across branches? For example, if the orion branch had the exact same kernel patch series and patches, would it re-use the same kernel RPMs as the master branch? For that matter, are kernel builds even re-used across different commits on the same branch if they have the same series and patches?

[Brian Murrell (Inactive)]

Is there any mechanism to consolidate kernel builds across branches?

Kernel builds are cached independent of branch.

For example, if the orion branch had the exact same kernel patch series and patches,

and target definition (i.e. the targets/* file for the kernel) and kernel config file (i.e. the kernel_configs/* file for the kernel)

would it re-use the same kernel RPMs as the master branch?

Yes.

For that matter, are kernel builds even re-used across different commits on the same branch if they have the same series and patches?

Yes.

For the record, the algorithm for determining the cache slot for a kernel is:

is_release_boolean + build_system_version + kernel_config_file + target_file + full_patch

all concatenated together and hashed with md5sum.

It's not as smart as it could be given that there is stuff in the target files that doesn't actually make a kernel different and whitespace changes in any of those files are not ignored, but those are all diminishing returns I suspect.

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,sles11,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-rhel6
• build/lbuild-sles
• build/lbuild-rhel
• build/lbuild
• build/lbuild-fc12
• build/lbuild-fc
• build/lbuild-fc11

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-fc12
• build/lbuild-fc11
• build/lbuild-fc
• build/lbuild-rhel6
• build/lbuild-rhel
• build/lbuild-sles
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-fc12
• build/lbuild-fc
• build/lbuild-sles
• build/lbuild-rhel
• build/lbuild
• build/lbuild-fc11
• build/lbuild-rhel6

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild-fc
• build/lbuild-rhel6
• build/lbuild-rhel
• build/lbuild-fc11
• build/lbuild
• build/lbuild-fc12

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild-fc11
• build/lbuild-fc12
• build/lbuild-rhel6
• build/lbuild-rhel
• build/lbuild-fc
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,ofa #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild-fc12
• build/lbuild-rhel
• build/lbuild
• build/lbuild-fc11
• build/lbuild-fc
• build/lbuild-rhel6

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild-rhel
• build/lbuild-rhel6
• build/lbuild
• build/lbuild-fc12
• build/lbuild-fc11
• build/lbuild-fc

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild-fc12
• build/lbuild-fc11
• build/lbuild
• build/lbuild-fc
• build/lbuild-rhel6
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-fc
• build/lbuild-rhel6
• build/lbuild-fc11
• build/lbuild-fc12
• build/lbuild
• build/lbuild-rhel
• build/lbuild-sles

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild
• build/lbuild-fc12
• build/lbuild-fc
• build/lbuild-rhel6
• build/lbuild-fc11
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,ofa #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-fc
• build/lbuild-fc11
• build/lbuild-sles
• build/lbuild-fc12
• build/lbuild
• build/lbuild-rhel6
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-rhel6
• build/lbuild-fc
• build/lbuild-fc12
• build/lbuild-sles
• build/lbuild
• build/lbuild-rhel
• build/lbuild-fc11

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-sles
• build/lbuild-fc11
• build/lbuild-rhel6
• build/lbuild
• build/lbuild-fc
• build/lbuild-fc12
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-rhel
• build/lbuild-fc11
• build/lbuild-rhel6
• build/lbuild-fc
• build/lbuild-sles
• build/lbuild-fc12
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #139
LU-363 don't cache BUILD for reuse

Oleg Drokin : c66d8316766c3b35032d6bee7113a74cd690105c
Files :

• build/lbuild-fc12
• build/lbuild-rhel6
• build/lbuild
• build/lbuild-fc
• build/lbuild-fc11
• build/lbuild-sles
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-b1_8 » x86_64,client,ubuntu1004,inkernel #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel
• build/lbuild-rhel6
• build/lbuild-sles
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-b1_8 » x86_64,client,el5,ofa #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild
• build/lbuild-rhel6
• build/lbuild-rhel
• build/lbuild-sles

[Build Master (Inactive)]

Integrated in lustre-b1_8 » x86_64,server,el5,ofa #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel
• build/lbuild-sles
• build/lbuild-rhel6
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-b1_8 » x86_64,client,el6,inkernel #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel6
• build/lbuild
• build/lbuild-rhel
• build/lbuild-sles

[Build Master (Inactive)]

Integrated in lustre-b1_8 » x86_64,server,el5,inkernel #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel6
• build/lbuild
• build/lbuild-sles
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-b1_8 » x86_64,client,el5,inkernel #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-sles
• build/lbuild-rhel6
• build/lbuild
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-b1_8 » i686,client,el6,inkernel #66
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel
• build/lbuild-rhel6
• build/lbuild
• build/lbuild-sles

[Build Master (Inactive)]

Integrated in lustre-b1_8 » i686,client,el5,inkernel #67
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel6
• build/lbuild-rhel
• build/lbuild-sles
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-b1_8 » i686,client,el5,ofa #67
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel
• build/lbuild-rhel6
• build/lbuild-sles
• build/lbuild

[Build Master (Inactive)]

Integrated in lustre-b1_8 » i686,server,el5,ofa #67
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-sles
• build/lbuild
• build/lbuild-rhel6
• build/lbuild-rhel

[Build Master (Inactive)]

Integrated in lustre-b1_8 » i686,server,el5,inkernel #67
LU-363 don't cache BUILD for reuse

Johann Lombardi : 42250b8243650ac3401f699bf564ff028e0cf6e8
Files :

• build/lbuild-rhel6
• build/lbuild
• build/lbuild-rhel
• build/lbuild-sles