[LU-958] tests: debug_mb set incorrectly for smp or vm

• Status: Resolved
• Project: Lustre
• Fix Version/s: Lustre 2.3.0, Lustre 2.1.3, Lustre 1.8.9
• Type: Bug
• Priority: Minor
• Reporter: Denis Kondratenko (Inactive)
• Assignee: WC Triage
• Resolution: Fixed

Environment

VMwareFusion on MacBook Pro
or node with 8 processors, 4 cpu cores each

• Severity: 3

Description

Actually debug_mb in lustre code depends from num_possible_cpus(). That could be different number than number of CPU in the system.

Test suit reads CPU in the system.

Fixed in MRP-219 of Xyratex by using /sys/devices/system/cpu/possible.

Issue Links

• duplicates: LU-1249 lctl set_param debug_mb=10 gives Inva...

Comments

[Denis Kondratenko (Inactive)]

http://review.whamcloud.com/#change,1912

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,sles11,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Peter Jones]

Landed for 2.2

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,ofa #494
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Di Wang]

[root@testnode1 tests]# sh llmount.sh
cut: /sys/devices/system/cpu/possible: No such file or directory
status script Total(sec) E(xcluded) S(low)
------------------------------------------------------------------------------------
touch: missing file operand
Try `touch --help' for more information.

I got this in my test. so you probably need check whether /sys/devices/system/cpu/possible exists in the script.

[Denis Kondratenko (Inactive)]

why it happens? hotpulg isn't enabled, sysfs isn't mounted, or 32 bit node?

we could check file and use getconf _NPROCESSORS_CONF if not exist.

[Sarah Liu]

I got the same error as Di in the downgrade testing. Client-17 is running 2.2 RHEL5 client.

client-17: cut: /sys/devices/system/cpu/possible: No such file or directory
client-17: status script Total(sec) E(xcluded) S(low)
client-17: ------------------------------------------------------------------------------------
client-17: touch: missing file operand
client-17: Try `touch --help' for more information.

[root@client-17 tests]# ls /sys/devices/system/cpu/
cpu0 cpu1 cpu2 cpu3 sched_mc_power_savings sched_smt_power_savings
[root@client-17 tests]# uname -a
Linux client-17.lab.whamcloud.com 2.6.18-238.19.1.el5 #1 SMP Fri Jul 15 07:31:24 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux
[root@client-17 tests]# rpm -qa|grep lustre
lustre-client-2.2.0-2.6.18_238.19.1.el5
lustre-client-modules-2.2.0-2.6.18_238.19.1.el5
lustre-client-tests-2.2.0-2.6.18_238.19.1.el5
[root@client-17 tests]#

[Di Wang]

Hmm, I still use rhel5 kernel. hotplug is enable here. sysfs is mounted 64 bit code.
[root@testnode1 ~]# ls /sys/devices/system/cpu/
cpu0 cpu1

Anyway, I think you might need check whether /sys/devices/system/cpu/possible exists before using it.

[Denis Kondratenko (Inactive)]

OK, will add that

[Denis Kondratenko (Inactive)]

http://review.whamcloud.com/2377

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el6,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el6,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,sles11,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el6,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el6,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,ubuntu1004,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,client,el5,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,server,el5,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » i686,server,el5,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,inkernel #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-master » x86_64,client,el5,ofa #529
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Andreas Dilger]

This was landed to master for Lustre 2.3.

[Andreas Dilger]

While this patch has landed and fixes the immediate problem, I think the root cause is that the debug_mb tunable is not easily usable. A better fix (to be done under LU-1249) is to make debug_mb more accepting of values and limit the supplied value to min/max instead of returning an error.

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,client,el5,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-dev » i686,client,el6,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-dev » i686,server,el5,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,server,el6,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-dev » i686,client,el5,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,server,el5,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Build Master (Inactive)]

Integrated in lustre-dev » x86_64,client,el6,inkernel #340
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 2ccb34d882b01305794e7780b6dd691179ddae7e)
LU-958 tests: debug_mb set incorrectly for smp or vm (Revision 28817cbd133c626042f9b142600c03187ba4a7ce)

Result = SUCCESS
Oleg Drokin : 2ccb34d882b01305794e7780b6dd691179ddae7e
Files :

• lustre/tests/cfg/local.sh
• lustre/tests/test-framework.sh

Oleg Drokin : 28817cbd133c626042f9b142600c03187ba4a7ce
Files :

• lustre/tests/test-framework.sh
• lustre/tests/cfg/local.sh

[Nathan Rutman]

Xyratex: MRP-219

[Emoly Liu]

Patch for b1_8: http://review.whamcloud.com/4962