Console [eagle-44vm1] log opened at 2014-10-26 03:45:03 UTC. Console [eagle-44vm1] disconnected from at 10-27 05:12. Console [eagle-44vm1] connected to at 10-27 05:12. Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.32-431.el6.x86_64 (mockbuild@c6b8.bsys.dev.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4) (GCC) ) #1 SMP Fri Nov 22 03:15:09 UTC 2013 Command line: initrd=/images/CentOS-6.5-x86_64/initrd.img ksdevice=bootif lang= console=tty0 console=ttyS0,115200 kssendmac text ks=http://10.100.0.10/cblr/svc/op/ks/system/eagle-44vm1 BOOT_IMAGE=/images/CentOS-6.5-x86_64/vmlinuz BOOTIF=01-00-16-3e-18-6e-86 KERNEL supported cpus: Intel GenuineIntel AMD AuthenticAMD Centaur CentaurHauls BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009dc00 (usable) BIOS-e820: 000000000009dc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 000000007fffd000 (usable) BIOS-e820: 000000007fffd000 - 0000000080000000 (reserved) BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved) DMI 2.4 present. SMBIOS version 2.4 @ 0xFDA30 Hypervisor detected: KVM last_pfn = 0x7fffd max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x0, new 0x7010600070106 init_memory_mapping: 0000000000000000-000000007fffd000 RAMDISK: 7dece000 - 7fea44ff ACPI: RSDP 00000000000fda00 00014 (v00 BOCHS ) ACPI: RSDT 000000007fffd670 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) ACPI: FACP 000000007ffffe40 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) ACPI: DSDT 000000007fffd950 024A2 (v01 BXPC BXDSDT 00000001 INTL 20090123) ACPI: FACS 000000007ffffe00 00040 ACPI: SSDT 000000007fffd8b0 0009E (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001) ACPI: APIC 000000007fffd7c0 00078 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) ACPI: SSDT 000000007fffd6b0 0010F (v01 BXPC BXSSDTPC 00000001 INTL 20090123) Setting APIC routing to flat. No NUMA configuration found Faking a node at 0000000000000000-000000007fffd000 Bootmem setup node 0 0000000000000000-000000007fffd000 NODE_DATA [000000000000a000 - 000000000003dfff] bootmap [000000000003e000 - 000000000004dfff] pages 10 (7 early reservations) ==> bootmem [0000000000 - 007fffd000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #2 [0001000000 - 000201faa4] TEXT DATA BSS ==> [0001000000 - 000201faa4] #3 [007dece000 - 007fea44ff] RAMDISK ==> [007dece000 - 007fea44ff] #4 [000009dc00 - 0000100000] BIOS reserved ==> [000009dc00 - 0000100000] #5 [0002020000 - 0002020081] BRK ==> [0002020000 - 0002020081] #6 [0000008000 - 000000a000] PGTABLE ==> [0000008000 - 000000a000] found SMP MP-table at [ffff8800000fda50] fda50 kvm-clock: Using msrs 4b564d01 and 4b564d00 kvm-clock: cpu 0, msr 0:1c247c1, boot clock Zone PFN ranges: DMA 0x00000001 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal 0x00100000 -> 0x00100000 Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000001 -> 0x0000009d 0: 0x00000100 -> 0x0007fffd ACPI: PM-Timer IO Port: 0xb008 Setting APIC routing to flat. ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Using ACPI (MADT) for SMP configuration information SMP: Allowing 1 CPUs, 0 hotplug CPUs PM: Registered nosave memory: 000000000009d000 - 000000000009e000 PM: Registered nosave memory: 000000000009e000 - 00000000000a0000 PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000 PM: Registered nosave memory: 00000000000f0000 - 0000000000100000 Allocating PCI resources starting at 80000000 (gap: 80000000:7ffbc000) Booting paravirtualized kernel on KVM NR_CPUS:4096 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 PERCPU: Embedded 31 pages/cpu @ffff880002200000 s94872 r8192 d23912 u2097152 pcpu-alloc: s94872 r8192 d23912 u2097152 alloc=1*2097152 pcpu-alloc: [0] 0 kvm-clock: cpu 0, msr 0:22167c1, primary cpu clock kvm-stealtime: cpu 0, msr 220e880 Built 1 zonelists in Node order, mobility grouping on. Total pages: 516914 Policy zone: DMA32 Kernel command line: initrd=/images/CentOS-6.5-x86_64/initrd.img ksdevice=bootif lang= console=tty0 console=ttyS0,115200 kssendmac text ks=http://10.100.0.10/cblr/svc/op/ks/system/eagle-44vm1 BOOT_IMAGE=/images/CentOS-6.5-x86_64/vmlinuz BOOTIF=01-00-16-3e-18-6e-86 PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found AMD-Vi disabled by default: pass amd_iommu=on to enable Memory: 2018320k/2097140k available (5325k kernel code, 400k absent, 78420k reserved, 7013k data, 1276k init) Hierarchical RCU implementation. NR_IRQS:33024 nr_irqs:256 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled allocated 8388608 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Detected 2000.138 MHz processor. Calibrating delay loop (skipped) preset value.. 4000.27 BogoMIPS (lpj=2000138) pid_max: default: 32768 minimum: 301 Security Framework initialized SELinux: Initializing. Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes) Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys devices Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys blkio Initializing cgroup subsys perf_event Initializing cgroup subsys net_prio mce: CPU supports 10 MCE banks alternatives: switching to unfair spinlock SMP alternatives: switching to UP code Freeing SMP alternatives: 36k freed ACPI: Core revision 20090903 ftrace: converting mcount calls to 0f 1f 44 00 00 ftrace: allocating 21769 entries in 86 pages APIC routing finalized to flat. ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: AMD QEMU Virtual CPU version (cpu64-rhel6) stepping 03 Performance Events: Broken PMU hardware detected, using software events only. NMI watchdog disabled (cpu0): hardware events not enabled Brought up 1 CPUs Total of 1 processors activated (4000.27 BogoMIPS). x86 PAT enabled: cpu 0, old 0x70106, new 0x7010600070106 devtmpfs: initialized regulator: core version 0.5 NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using configuration type 1 for base access bio: create slab at 0 ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing ACPI: No dock devices found. PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) PCI host bridge to bus 0000:00 pci_bus 0000:00: root bus resource [io 0x0000-0xffff] pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffffffff] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) ACPI: PCI Interrupt Link [LNKS] (IRQs *9) vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded vgaarb: bridge control possible 0000:00:02.0 SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing lo: Dropping TSO features since no CSUM feature. NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default Switching to clocksource kvm-clock pnp: PnP ACPI init ACPI: bus type pnp registered pnp: PnP ACPI: found 6 devices ACPI: ACPI bus type pnp unregistered NET: Registered protocol family 2 IP route cache hash table entries: 65536 (order: 7, 524288 bytes) TCP established hash table entries: 262144 (order: 10, 4194304 bytes) TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) TCP: Hash tables configured (established 262144 bind 65536) TCP reno registered NET: Registered protocol family 1 pci 0000:00:00.0: Limiting direct PCI/PCI transfers pci 0000:00:01.0: PIIX3: Enabling Passive Release pci 0000:00:01.0: Activating ISA DMA hang workarounds ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11 pci 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 pci 0000:00:01.2: PCI INT D disabled Trying to unpack rootfs image as initramfs... Freeing initrd memory: 32601k freed audit: initializing netlink socket (disabled) type=2000 audit(1414386790.241:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) msgmni has been set to 4005 alg: No test for stdrng (krng) ksign: Installing public key data Loading keyring - Added public key 8A44323FB303E068 - User ID: CentOS (Kernel Module GPG key) Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) pci_hotplug: PCI Hot Plug PCI Core version: 0.5 pciehp: PCI Express Hot Plug Controller Driver version: 0.4 acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 acpiphp: Slot [1] registered acpiphp: Slot [2] registered acpiphp: Slot [3] registered acpiphp: Slot [4] registered acpiphp: Slot [5] registered acpiphp: Slot [6] registered acpiphp: Slot [7] registered acpiphp: Slot [8] registered acpiphp: Slot [9] registered acpiphp: Slot [10] registered acpiphp: Slot [11] registered acpiphp: Slot [12] registered acpiphp: Slot [13] registered acpiphp: Slot [14] registered acpiphp: Slot [15] registered acpiphp: Slot [16] registered acpiphp: Slot [17] registered acpiphp: Slot [18] registered acpiphp: Slot [19] registered acpiphp: Slot [20] registered acpiphp: Slot [21] registered acpiphp: Slot [22] registered acpiphp: Slot [23] registered acpiphp: Slot [24] registered acpiphp: Slot [25] registered acpiphp: Slot [26] registered acpiphp: Slot [27] registered acpiphp: Slot [28] registered acpiphp: Slot [29] registered acpiphp: Slot [30] registered acpiphp: Slot [31] registered ipmi message handler version 39.2 IPMI System Interface driver. ipmi_si: Adding default-specified kcs state machine ipmi_si: Trying default-specified kcs state machine at i/o address 0xca2, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Adding default-specified smic state machine ipmi_si: Trying default-specified smic state machine at i/o address 0xca9, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Adding default-specified bt state machine ipmi_si: Trying default-specified bt state machine at i/o address 0xe4, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Unable to find any System Interface(s) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] ACPI Exception: AE_NOT_FOUND, No or invalid critical threshold (20090903/thermal-386) GHES: HEST is not enabled! Non-volatile memory driver v1.3 Linux agpgart interface v0.103 crash memory driver: version 1.1 Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled erial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A brd: module loaded loop: module loaded input: Macintosh mouse button emulation as /devices/virtual/input/input1 Fixed MDIO Bus: probed ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver uhci_hcd: USB Universal Host Controller Interface driver uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 uhci_hcd 0000:00:01.2: UHCI Host Controller uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020 usb usb1: New USB device found, idVendor=1d6b, idProduct=0001 usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 usb usb1: Product: UHCI Host Controller usb usb1: Manufacturer: Linux 2.6.32-431.el6.x86_64 uhci_hcd usb usb1: SerialNumber: 0000:00:01.2 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mice: PS/2 mouse device common for all mice input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2 rtc_cmos 00:01: RTC can wake from S4 rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 rtc0: alarms up to one day, 114 bytes nvram cpuidle: using governor ladder cpuidle: using governor menu EFI Variables Facility v0.08 2004-May-17 usbcore: registered new interface driver hiddev usbcore: registered new interface driver usbhid usbhid: v2.6:USB HID core driver GRE over IPv4 demultiplexor driver TCP cubic registered Initializing XFRM netlink socket NET: Registered protocol family 17 registered taskstats version 1 rtc_cmos 00:01: setting system clock to 2014-10-27 05:13:10 UTC (1414386790) Initalizing network drop monitor service Freeing unused kernel memory: 1276k freed Write protecting the kernel read-only data: 10240k Freeing unused kernel memory: 800k freed Freeing unused kernel memory: 1588k freed [9;0][8] Greetings. anaconda installer init version 13.21.215 starting mounting /proc filesystem... done creating /dev filesystem... done starting udev...done mounting /dev/pts (unix98 pty) filesystem... done mounting /sys filesystem... done anaconda installer init version 13.21.215 using a serial console trying to remount root filesystem read write... done mounting /tmp as tmpfs... done running install... running /sbin/loader %Gdetecting hardware... waiting for hardware to initialize... detecting hardware... waiting for hardware to initialize... (B)0Welcome to CentOS for x86_64┌───────────────────────────────────────────────────────┐│││ Waiting for NetworkManager to configure eth0.│││└───────────────────────────────────────────────────────┘/ between elements | selects | next screen     ┌────────────────────────────┤ Retrieving ├────────────────────────────┐│││ Retrieving /eagle-44vm1...││││ 0% │││└──────────────────────────────────────────────────────────────────────┘ 100%        ┌────────────────────────────┤ Retrieving ├────────────────────────────┐│││ Retrieving /updates.img...││││ 0% │││└──────────────────────────────────────────────────────────────────────┘ 100%        ┌────────────────────────────┤ Retrieving ├────────────────────────────┐│││ Retrieving /product.img...││││ 0% │││└──────────────────────────────────────────────────────────────────────┘ 100%        ┌────────────────────────────┤ Retrieving ├────────────────────────────┐│││ Retrieving /install.img...││││ 0% │││└──────────────────────────────────────────────────────────────────────┘ 100%  1%  23 4 56 7 89 10 12 34 5 67 8 920 1 23 4 56 78 9 301 2 34 5 67 89 40 12 3 445 46 478 49501234%5% 67% 8% 960% 1 23 45 6 78 9 701 2 34 5 67 89 80 12 3 45 6 78 990 1 23 4 56 7 89 100         Running anaconda 13.21.215, the CentOS system installer - please wait. (B)0┌───────────────┤ Examining Devices ├────────────────┐│││ Examining storage devices│││││└────────────────────────────────────────────────────┘/ between elements | selects | next screen      Welcome to CentOS for x86_64 ┌───────┤ Creating ├────────┐ ││ │ Creating device /dev/vda1 │ ││ └───────────────────────────┘     ┌───────────────────┤ Formatting ├───────────────────┐│││ Creating ext3 filesystem on /dev/vda1│││││└────────────────────────────────────────────────────┘       ┌───────┤ Creating ├────────┐ ││ │ Creating device /dev/vda2 │ ││ └───────────────────────────┘     ┌───────────────────┤ Formatting ├───────────────────┐│││ Creating swap on /dev/vda2│││││└────────────────────────────────────────────────────┘      ┌─────────────┤ Installation Progress ├──────────────┐│││ Retrieving installation information for CentOS. │││││└────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for CentOS-6.5-distro-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────┤ Installation Progress ├──────────────┐│││ Retrieving installation information for Lustre. │││││└────────────────────────────────────────────────────┘      ┌─────────────────┤ Installation Progress ├─────────────────┐│││ Retrieving installation information for Lustre-e2fsprogs. │││││└───────────────────────────────────────────────────────────┘      ┌──────────────────┤ Installation Progress ├──────────────────┐│││ Retrieving installation information for addon-epel6-x86_64. │││││└─────────────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for local-toolkit_el6-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────┤ Installation Progress ├──────────────┐│││ Retrieving installation information for source-1. │││││└────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for updates-centos6.0-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for updates-centos6.1-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for updates-centos6.2-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for updates-centos6.3-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for updates-centos6.4-x86_64. │││││└───────────────────────────────────────────────────────────────────┘      ┌─────────────────────┤ Installation Progress ├─────────────────────┐│││ Retrieving installation information for updates-centos6.5-x86_64. │││││└───────────────────────────────────────────────────────────────────┘       ┌────────────┤ Installation Progress ├────────────┐ ││ │ Retrieving installation information for CentOS. │ ││ └─────────────────────────────────────────────────┘      ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for CentOS-6.5-distro-x86_64.│ ││ └─────────────────────────────────────┘       ┌────────────┤ Installation Progress ├────────────┐ ││ │ Retrieving installation information for Lustre. │ ││ └─────────────────────────────────────────────────┘      ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for Lustre-e2fsprogs.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for addon-epel6-x86_64.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for local-toolkit_el6-x86_64.│ ││ └─────────────────────────────────────┘      ┌─────────────┤ Installation Progress ├─────────────┐│││ Retrieving installation information for source-1. │││└───────────────────────────────────────────────────┘      ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for updates-centos6.0-x86_64.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for updates-centos6.1-x86_64.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for updates-centos6.2-x86_64.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for updates-centos6.3-x86_64.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for updates-centos6.4-x86_64.│ ││ └─────────────────────────────────────┘       ┌──────┤ Installation Progress ├──────┐ ││ │ Retrieving installation information │ │ for updates-centos6.5-x86_64.│ ││ └─────────────────────────────────────┘      ┌────────────────────┤ Dependency Check ├─────────────────────┐│││ Checking dependencies in packages selected for installation ││││ 0% │││└─────────────────────────────────────────────────────────────┘1 23 45 6 78 910 1 23 45 6 78 920 12 3 45 67 8 930 12 3 45 67 8 940 12 434 45 467 48950123%45% 6% 78% 960% 12 3 45 6100        ┌────────────────┤ Installation Starting ├────────────────┐│││ Starting installation process││││ 0% │││└─────────────────────────────────────────────────────────┘1 23 45 67 89 10 12 34 56 78 9 201 23 45 67 89 30 12 34 56 78 9 401 423 445 467 48950123%45% 67% 89% 60% 12 34 56 78 970 1 23 45 67 89 80 12 34 56 78 990 1 23 45 67 89        ┌────────────────┤ Preparing to install ├─────────────────┐│││ Preparing transaction from installation source││││ 0% │││└─────────────────────────────────────────────────────────┘ 1 2 3 4 560% 7 8 9        ┌─────────────────────┤ Package Installation ├──────────────────────┐│││││ 0% │││││││││││││││││└───────────────────────────────────────────────────────────────────┘Installing libgcc-4.4.7-4.el6.x86_64 (114 KB)GCC version 4.4 shared support libraryPackages completed: 1 of 476setup-2.8.14-20.el6_4.1.noarch (650 KB)A set of system configuration and setup files2 filesystem-2.4.30-3.el6.x86_64 (0 Bytes)The basic directory layout for a Linux system3 bas10.0-4.el6.noarch (0 Bytes) skeleton package which defines a simple Red Hat Enterprise Linux system4 libX11-common-1.5.0-4.el6.noarch (1 MB)Common data for libX11  5 ncurses-base-5.7-3.20090208.el6.x86_64 (188 KB)Descriptions of common terminals6 tzdata-2014h-1.el6.noarch (1 MB) Timezone data 7 glibc-common-2.12-1.132.el6_5.4.x86_64 (107 MB)Common binaries and locale data for glibc8  14nss-softokn-freebl-3.14.3-12.el6_5.x86_64 (459 KB)Freebl library for the Network Security Services9 glibc-2.12-1.132.el6_5.4.x86_64 (12 MB) The GNU libc libraries 10 of 476 6ncurses-libs-5.7-3.20090208.el6.x86_64 (742 KB)Ncurses libraries 1 bash-4.1.2-15.el6_5.2.x86_64 (2 MB) The GNU Bourne Again shell2 libattr-2.4.44-7.el6.x86_64 (18 KDynamic library for extended attribute support3 cap-2.16-5.5.el6.x86_64 (62 KB) Library for getting and setting POSIX.1e capabilities4 zlib-1.2.3-29.el6.x86_64 (148 KB) The zlib compression and decompression library 5 info-4.13a-8.el6.x86_64 (321 KB) A stand-alone TTY-based reader for GNU texinfo documentation6 libstdc++-4.4.7-4.el6.x86_64 (963 KB)GNU Standard C++ Library 7 dbus-libs-1.2.24-7.el6_3.x86_64 (259 KB)Libraries for accessing D-BUS8 audit-libs-2.2-4.el6_5.x86_64 (169 KB) Dynamic library for libaudit 9 popt-1.13-7.el6.x86_64 (81 KB) C library for parsing command line parameters20 chkconfig-1.3.49.3-2.el6_4.1.x86_64 (654 KB)A system tool for maintaining the /etc/rc*.d hierarchy1  7nspr-4.10.6-1.el6_5.x86_64 (271 KB) Netscape Portable Runtime 2 libcom_err-1.42.12.wc1-7.el6.x86_64 (55 KB)Common error description library3 db4-4.7.25-18.el6_4.x86_64 (1 MB) The Berkeley DB database (version 4) for C4 libacl-2.2.49-6.el630 KB)Dynamic library for access control list support 5 ibverbs-1.1.7-1.el6.x86_64 (100 KB)A library for direct userspace use of RDMA (InfiniBand/iWARP)hardware6 nss-util-3.16.1-2.el6_5.x86_64 (175 KB)Network Security Services Utilities Library  7 libxml2-2.7.6-14.el6_5.2.x86_64 (1 MB) Library providing XML and HTML support 8 sepol-2.0.41-4.el6.x86_64 (242 KB) SELinux binary policy manipulation library9 linux-2.0.94-5.3.el6_4.1.x86_64 (127 KB)library and simple utilities 30 shadow-utils-4.1.4.2-13.el6.x86_64 (2 MB) Utilities for managing accounts and shadow password files1 ed-4.2.1-10.el6.x86_64 (529 KB) A GNU stream text editor 2 8bzip2-libs-1.0.5-7.el6_0.x86_64 (66 KB)Libraries for applications using bzip23 freetype-2.3.11-143.1.x86_64 (815 KB)A free and portable font rendering engine4 elfutils-libelf-0.152-1.el6.x86_64 (898 KB)Library to read and write ELF files 5 xpat-2.0.1-11.el6_2.x86_64 (193 KB) An XML parser library 6 readline-6.0-4.el6.x86_64 (423 KB)  library for editing typed command lines7 gawk-3.1.7-10.el6.x86_64 (1 MB) The GNU version of the awk text processing utility8 libuuid-2.17.2-12.14.el6_5.x86_64 (15 KB)Universally unique ID library 9 jpeg-turbo-1.2.1-3.el6_5.x86_64 (465 KB)A MMX/SSE2 accelerated library for manipulating JPEG image files 40 blkid-2.17.2-12.14132 Block device ID library 1 png-1.2.49-1.el6_2.x86_64 (639 KB) A library of functions for manipulating PNG image format files 2 ibumad-1.3.8-1.el689 KB) OpenFabrics Alliance InfiniBand umad (user MAD) library 3 btparser-0.17-2.el6.x86_64 (132 KB) Parser and analyzer for backtraces produced by GDB 4 xz-libs-4.999.9-0.3.beta.20091007git.el6.x86_64 (209 KB) Libraries for decoding LZMA compression5 mlrpc-c-1.16.24-1210.1840.el6.x86_64 (262 KB) A lightweight RPC library based on XML and HTTP 6 tcl-8.5.7-6.el6.x86_64 (4 MB) Tool Command Language, pronounced tickle 7  9bzip2-1.0.5-7.el6_0.x86_64 (77 KB)A file compression utility 8 findutils-4.4.2-6.el6.x86_64 (1 MB)The GNU versions of find utilities (find and xargs)9 cyrus-sasl-lib-2.1.23-13.el6_3.1.x86_64 (349 KB)Shared libraries needed by applications which use Cyrus SASL50 libidn-1.18-2.el6.x86_64 (554 KB) Internationalized Domain Name support library 1 file-libs-5.04-15.el6.x86_64 (2 MB)Libraries for applications using libmagic 2  20tcp_wrappers-libs-7.6-57.el6.x86_64 (128 KB)tcp_wrappers 3 pciutils-libs-3.1.10-2.el6.x86_64 (47 KB) nux PCI library 4 libcap-ng-0.6.4-3.el6_0.1.x86_64 (44 KB) An alternate posix capabilities library5 dbus-1.2.24-7.el6_3.x86_64 (471 KB) D-BUS message bus 6 libgpg-error-1.7-4.el6.x86_64 (209 KB)Library for error values used by GnuPG components7 crypt-1.4.5-11.el6_4.x86_64 (524 KB)A general-purpose cryptography library 8 udev-147-2.51.el6.x86_64 (71 KB) Dynamic library to access udev device information9 nl-1.1.4-2.el6.x86_64 (353 KB) Convenience library for kernel netlink sockets 60 elfutils-libs-0.152-1.el6.x86_64 (477 KB)Libraries to handle compiled objects 1 lua-5.1.4-4.1.el6.x86_64 (603 KB) Powerful light-weight programming language2 sqlite-3.6.20-1.el6.x86_64 (625 KB)Library that implements an embeddable SQL database engine3 procps-3.2.8-25454 System and process monitoring utilities 4 librdmacm-1.0.17-1.el6.x86_64 (120 KB)Userspace RDMA Connection Manager 5 e2fsprogs-libs-1.42.12.wc1-7.el6.x86_64 (356 KB)Ext2/3/4 filesystem-specific shared libraries6 pcre-7.8-6.el6.x86_64 (513 KB) Perl-compatible regular expression library 7 grep-2.6.3-4.el6_5.1.x86_64 (784 KB)attern matching utilities 8 cpio-2.10-12x86_64 (635 KB) A GNU archiving program 9 which-2.19-6.el6.x86_64 (71 KB) Displays where a particular program in your path is located70 gdbm-1.8.0-36.el6.x86_64 (47 KB)A GNU set of database routines which use extensible hashing1 perl-Pod-Escapes-1.04-136.el6.x86_64 (20 KB)Perl module for resolving POD escape sequences 2 libs-5.10.1-136.el6.x86_64 (1 MB) The libraries for the perl runtime 3 1version-0.77-136.el6.x86_64 (50 KB)Perl extension for Version Objects4 Module-Pluggable-3.90-136.el6.x86_64 (30 KB)Automatically give your module the ability to have plugins5 Pod-Simple-3.13-136.el6.x86_64 (465 KB) Framework for parsing POD documentation 6 5.10.1-136.el6.x86_64 (33 MB) Practical Extraction and Report Language7  5libICE-1.0.6-1.el6.x86_64 (114 KX.Org X11 ICE runtime library 8 tasn1-2.3-6.el6_5.x86_64 (432 KB)The ASN.1 library used in GNUTLS9 p11-kit-0.18.5-2.el6_5.2.x86_64 (256 KB)Library for loading and sharing PKCS#11 modules80 libSM-1.2.1-2.el6.x86_64 (76 KB) X.Org X11 SM runtime library 1 nss-softokn-3.14.3-12.el6_5.x86_64 (1 MB)Network Security Services Softoken Module2 xz-4.999.9-0.3.beta.20091007git.el6.x86_64 (476 KB) LZMA compression utilities 3 opensm-libs-3.3.15-1.el6.x86_64 (165 KB) ibraries used by opensm and included utilities4 libtiff-3.9.4-10.el6_5.x86_64 (939 KB) y of functions for manipulating TIFF format image files5 psmisc-22.6-19.el6_5.x86_64 (217 KB) Utilities for managing processes on your system 6 6libselinux-utils-2.0.94-5.3.el6_4.1.x86_64 (61 KB)SELinux libselinux utilies 7 checkpolicy-2.0.22-1.el6.x86_64 (849 KB) policy compiler 8 tar-1.23-11.el6.x86_64 (2 MB) A GNU file archiving program9 libusb-0.1.12-23.el6.x86_64 (53 KB)library which allows userspace access to USB devices90 tar-1.2.11-17.el6_4.1.x86_64 (63 KB)Tar file manipulation API 1 edit-2.11-4.20080712cvs.1.el6.x86_64 (181 KB)he NetBSD Editline library2 pth-2.0.7-9.3.el6.x86_64 (255 KB) GNU Portable Threads library3 sysvinit-tools-2.87-5.dsf.el6.x86_64 (110 KB)ools used for process and utmp management.4 numactl-2.0.7-8.el6.x86_64 (159 KB) Library for tuning for Non Uniform Memory Access machines5 pkgconfig-0.23-9.1.el6.x86_64 (136 KB)A tool for determining compilation options 6 libusb1-1.0.9-0.6.rc1.el6.x86_64 (201 KB)library which allows userspace access to USB devices7 dmidecode-2.12-5.el6_5.x86_64 (190 KB) Tool to analyse BIOS DMI data 8 shared-mime-info-0.70-4.el6.x86_64 (1 MB)Shared MIME information database9 glib2-2.26.1-7.el6_5.x86_64 (6 MB) A library of handy utility functionsPackages completed: 100  7amin-0.1.10-9.el6.x86_64 (406 KLibrary providing the FAM File Alteration Monitor API1 dbus-glib-0.86-6.el6.x86_64 (566 KB)GLib bindings for D-Bus 2 atk-1.30.0-1.el6.x86_64 (935 KB) Interfaces for accessibility support3 eggdbus-0.6-3.el6.x86_64 (313 KB)Experimental D-Bus bindings for GObject4 grubby-7.0.15-5.el6.x86_64 (82 KB)Command line tool for updating bootloader configs5 desktop-file-utils-0.15-9.el6.x86_64 (140 KB)Utilities for manipulating .desktop files 6  8ibutils-libs-1.5.7-8.el6.x86_64 (8 MB) Shared libraries used by ibutils binari7 9xz-lzma-compat-4.999.9-0.3.beta.20091007git.el6.x86_64 (20 KB) Older LZMA format compatibility binaries8 p11-kit-trust-0.18.5-2.el6_5.2.x86_64 (174 KB) System trust module from p11-kit 9 ca-certificates-2014.1.98-65.0.el6_5.noarch (2 MB)The Mozilla CA root certificate bundle10 gnutls-2.8.5-14.el6_5.x86_64 (1003 KB) A TLS protocol implementation 1 elfutils-0.152-1.el6.x86_64 (543 KB) collection of utilities and DSOs to handle compiled objects2 iw-3.10-1.1.el6.x86_64 (129 KB) nl80211 based wireless configuration tool 3 hal-libs-0.5.14-11.el6.x86_64 (105 KB)Libraries for accessing HAL 4 tcp_wrappers-7.6-57.el6.x86_64 (146 KB)A security tool which acts as a wrapper for TCP daemons5 file-5.04-15.el6.x86_64 (55 KB) utility for determining file types 6 libibmad-1.3.9-1.el6.x86_64 (196 KB)OpenFabrics Alliance InfiniBand MAD library7 jasper-libs-1.900.1-15.el6_1.1.x86_64 (329 KB)Runtime libraries for jasper 8 infinipath-psm-3.0.1-115.1015_open.2.el6.x86_64 (371 KB) QLogic PSM Libraries9 bc-1.06.95-1.el6.x86_64 (212 KB) GNU's bc (a numeric processing language) and dc (a calculator)  20 device-mapper-persistent-data-0.2.8-4.el6_5.x86_64 (6 MB) Device-mapper thin provisioning tools1  30libutempter-1.1.5-4.1.el6.x86_64 (39 KB) A privileged helper for utmp/wtmp updates 2 MAKEDEV-3.24-6.el6.x86_64 (221 KB) ogram used for creating device files in /dev3 vim-minimal-7.2.411-1.8.el6.x86_64 (748 KB)minimal version of the VIM editor 4 net-tools-1.60-110.el6_2.x86_64 (759 KB) Basic networking tools 5  1acl-2.2.49-6.el6.x86_64 (188 KB) Access control list utilities6 db4-utils-4.7.25-18.el6_4.x86_64 (405 KB)Command line tools for managing Berkeley DB (version 4) databases 7 libss-1.42.12.wc1-7.el6.x86_64 (67 KB) interface parsing library 8 e2fsprogs-1.42.12.wc1-7.el6.x86_64 (2 MB)Utilities for managing ext2, ext3, and ext4 filesystems9 pinentry-0.7.6-6.el6.x86_64 (140 KB) Collection of simple PIN or passphrase entry dialogs 30 libnih-1.0.1-7.el6.x86_64 (475 KB) Lightweight application development library 1 upstart-0.6.5-13.el6_5.3.x86_64 (550 KB)An event-driven init system 2 avahi-libs-0.6.25-12.el6_5.3.x86_64 (112 KB)Libraries for avahi run-time use3 hunspell-1.2.8-16.el6.x86_64 (418 KB) A spell checker and morphological analyzer library4 gmp-4.3.1-7.el6_2.2.x86_64 (642 KB) GNU arbitrary precision library 5 swig-1.3.40-6.el6.x86_64 (4 MB) Connects C/C++/Objective C to some high-level programminglanguages6 2nappy-1.1.0-1.el6.x86_64 (112 KB)Fast compression and decompression library  7 diffutils-2.8.1-28.el6.x86_64 (575 KB)A GNU collection of diff utilities 8 binutils-2.20.51.0.2-5.36.el6.x86_64 (9 MB)binary utilities9  3libgomp-4.4.7-4.el6.x86_64 (95 KB) GCC OpenMP v3.0 shared support library40 make-3.81-20.el6.x86_64 (1 MB) A GNU tool which simplifies the build process for users1 4-1.4.13-5.el6.x86_64 (547 KB)The GNU macro processor 2 vim-common-7.2.411-1.8.el6.x86_64 (16 MB)common files needed by any version of the VIM editor3  6dash-0.5.5.1-4.el6.x86_64 (124 KB) Small and fast POSIX-compliant shell 4 ncurses-5.7-3.20090208.el6.x86_64 (377 KB)Ncurses support utilities 5 groff-1.18.1.4-21.el6.x86_64 (5 MB) A document formatting system6 less-436-10.el6.x86_64 (195 KB) text file browser similar to more, but better7 coreutils-libs-8.4-31.el6_5.2.x86_64 (5 KB)Libraries for coreutils 8 gzip-1.3.12-19.el6_4.x86_64 (220 KB) The GNU data compression program9 cracklib-2.8.16-4.el6.x86_64 (182 KB)A password-checking library 50 dicts-2.8.16-4.el6.x86_64 (8 MB)The standard CrackLib dictionaries1  8oreutils-8.4-31.el6_5.2.x86_64 (12 MB) A set of basic GNU tools commonly used in shell scripts2  9pam-1.1.1-17.el6.x86_64 (2 MB) n extensible library which provides authentication forapplications3 fontconfig-2.8.0-3.el6.x86_64 (440 KB)Font configuration and customization library  4  40module-init-tools-3.9-21.el6_4.x86_64 (1 MB)Kernel module management utilities. 5 hwdata-0.233-9.1.el6.noarch (4 MB) Hardware identification and configuration data6 redhat-logos-60.0.14-12.el6.centos.noarch (15 MB)CentOS-related icons and pictures 7  2plymouth-scripts-0.8.3-27.el6.centos.1.x86_64 (10 KB) Plymouth related scripts 8 ciutils-3.1.10-2.el6.x86_64 (179 KB) CI bus related utilities9 libpciaccess-0.13.1-2.el6.x86_64 (37 KB)access library 60 urw-fonts-2.4-10.el6.noarch (4 MB) Free versions of the 35 standard PostScript fonts1 3ConsoleKit-libs-0.4.1-3.el6.x86_64 (21 KB)ConsoleKit libraries 2 polkit-0.96-5.el6_4.x86_64 (600 KB) PolicyKit Authorization Framework3 ConsoleKit-0.4.1-3.el6.x86_64 (262 KB)System daemon for tracking users, sessions and seats4 logrotate-3.7.8-1782 KB) Rotates, compresses, removes and mails system log files5 tcsh-6.17-24.el6.x86_64 (1 MB) An enhanced version of csh, the C shell 6 alsa-lib-1.0.22-3.el6.x86_64 (1 MB)The Advanced Linux Sound Architecture (ALSA) library7 xdg-utils-1.0.2-17.20091016cvs.el6.noarch (207 KB)Basic desktop integration functions 8 nss-3.16.1-7.el6_5.x86_64 (2 MB) Network Security Services 9  44sysinit-3.16.1-7.el6_5.x86_64 (32 KB)System NSS Initialization70 tools-3.16.1-7.el6_5.x86_64 (1 MB) Tools for the Network Security Services1 openldap-2.4.23-341.x86_64 (774 KB)LDAP support libraries 2 libuser-0.56.13-5.el6.x86_64 (1 MB) A user and group account administration library3 passwd-0.77-4.el6_2.2349 KB)n utility for setting or changing passwords using PAM4 hicolor-icon-theme-0.11-1.1.el6.noarch (44 KB)Basic requirement for icon themes 5 compat-readline5-5.2-17.1.el6.x86_64 (355 KB) A library for editing typed command lines6 libaio-0.3.107-10.el6.x86_64 (33 KB) Linux-native asynchronous I/O access library7 ethtool-3.5-1.4.el6_5272 KB)Ethernet settings tool for PCI ethernet cards8 mingetty-1.08-5.el6.x86_64 (33 KB) A compact getty program for virtual consoles only9 lzo-2.03-3.1.el6_5.1.x86_64 (159 KB)Data compression library with very fast (de)compression80 sg3_utils-libs-1.28-5.el6.x86_64 (153 KB)Shared library for sg3_utils 1 munge-libs-0.5.10-1.el6.x86_64 (69 KB) Runtime libs for uid * gid authentication acrosss a host cluster 2 pdsh-rcmd-mrsh-2.29-1.wc1.x86_64 (34 KB)Provides mrsh rcmd capability to pdsh 3 lymouth-core-libs-0.8.3-27.el6.centos.1.x86_64 (173 KB) Plymouth libraries4 hdparm-9.43-4.el6.x86_64 (149 KB) A utility for displaying and/or setting hard disk parameters 5 libpcap-1.4.0-1.20130826git2dbcaa1.el6.x86_64 (307 KB) system-independent interface for user-level packet capture6 gpm-libs-1.20.6-12.el6.x86_64 (23 KB) Dynamic library for for the gpm 7 sgpio-1.2.0.10-5.el6.x86_64 (33 KB) SGPIO captive backplane tool 8 keyutils-libs-1.4-4.el6.x86_64 (35 KB)Key utilities library 9 rb5-libs-1.10.3-15.el6_5.1.x86_64 (2 MB)The shared libraries used by Kerberos 590  45openssl-1.0.1e-30.el6_5.2.x86_64 (4 MB) A general purpose cryptography library with TLS implementation 1 ruby-libs-1.8.7.352-13.el6.x86_64 (5 MB)Libraries necessary to run Ruby 2 61.8.7.352-13.el6.x86_64 (1 MB) An interpreter of object-oriented scripting language3 libssh2-1.4.2-1.el6.x86_64 (317 K library implementing the SSH2 protocol 4 curl-7.19.7-37.el6_5.3.x86_64 (335 KB)for getting files from web servers5 xmlrpc-c-client-1.16.24-1210.1840.el6.x86_64 (43 KB) C client libraries for xmlrpc-c 6 curl-7.19.7-37.el6_5.3.x86_64 (347 KB) A utility for getting files from remote servers (FTP, HTTP, and others)7 rpm-libs-4.8.0-37.el6.x86_64 (754 KB) Libraries for manipulating RPM packages  8 4.8.0-37.el6.x86_64 (1 MB) The RPM package management system 9  47mailx-12.4-451 KB)Enhanced implementation of the mailx command200 n-1.6f-32.el6.x86_64 (389 KB) A set of documentation tools: man, apropos and whatis1 gnupg2-2.0.14-6.el6_4.x86_64 (5 MB)Utility for secure communication and data storage 2  48pgme-1.1.8-3.el6.x86_64 (712 KB) GnuPG Made Easy - high level crypto API 3 ruby-irb-1.8.7.352-13.el6.x86_64 (1 MB)The Interactive Ruby 4 rdoc-1.8.7.352-13.el6.x86_64 (1 MB)A tool to generate documentation from Ruby source files5 gems-1.3.7-5.el6.noarch (712 KB) The Ruby standard for packaging ruby libraries 6 -mixlib-log-1.6.0-1.el6.noarch (18 KB)Ruby mix-in for log functionality 7 json-1.4.6-1.el6.x86_64 (584 KB) A JSON implementation in Ruby 8 mixlib-config-1.1.2-1.el6.noarch (109 KB)class based config mixin, similar to the one found in Chef9 li-1.2.0-1.el6.noarch (111 KB) simple mixin for CLI interfaces, including option parsing 10 extlib-0.9.13-5.el6.noarch (177 KB) Support library for DataMapper and Merb 1 mixlib-authentication-1.1.4-1.el6.noarch (205 KB) Mixes in simple per-request authentication2 uuidtools-2.1.1-1.el6.noarch (53 KB) A simple universally unique ID generation library 3 moneta-0.6.0-1.el6.noarch (36 KB) unified interface to key/value stores 4 highline-1.6.1-1.el6.noarch (594 KB)HighLine is a high-level command-line IO library5 bunny-0.6.0-1.el6.noarch (175 KB) Another synchronous Ruby AMQP client 6 abstract-1.0.0-2.el6.noarch (15 KB)llows you to define an abstract method in Ruby7 erubis-2.6.5-2.el6.noarch (292 KB)  fast and extensible eRuby implementation 8 systemu-1.2.0-3.el6.noarch (20 Multi-platform command execution and capture9 ohai-0.5.8-1.el6.noarch (1 MB) Ohai profiles your system and emits JSON 20 9mime-types-1.16-3.el6.noarch (138 KB)Return the MIME Content-Type for a given filename1 rest-client-1.6.1-2.el6.noarch (572 KB)Simple REST client for Ruby 2 bind-libs-9.8.2-0.23.rc1.el6_5.1.x86_64 (2 MB) Libraries used by the BIND DNS packages3 mysql-libs-5.1.73-3.el6_5.x86_64 (4 MB) The shared libraries required for MySQL clients4 fipscheck-lib-1.2.0-7.el610 KB)Library files for fipscheck 5 1.2.0-7.el6.x86_64 (27 KB) A library for integrity verification of FIPS validated modules 6 libesmtp-1.0.4-15139 KB)SMTP client library 7 cups-libs-1.4.2-52.el6_5.2.x86_64 (649 KB)Common Unix Printing System - libraries8 50ustr-1.0.4-9.1.el6.x86_64 (267 KB) String library, very low memory overhead, simple to import9 libsemanage-2.0.43-4.2.el6.x86_64 (199 KB)ELinux binary policy manipulation library 30 slang-2.2.1-1.el6.x86_64 (1 MB) The shared library for the S-Lang extension language1 newt-0.52.11-3.el6.x86_64 (169 KB)A library for text mode user interfaces 2 libtool-ltdl-2.2.6-15.5.el6.x86_64 (63 KB)Runtime libraries for GNU Libtool Dynamic Module Loader3 gfortran-4.4.7-4.el6.x86_64 (964 KB) Fortran runtime 4 ffi-3.0.5-3.2.el6.x86_64 (41 KB) A portable foreign function interface library5 python-2.6.6-52.el6.x86_64 (77 KB) n interpreted, interactive, object-oriented programming language 6 libs-2.6.6-52.el6.x86_64 (21 MB)Runtime libraries for Python 7 3%rpm-python-4.8.0-37.el6.x86_64 (118 KPython bindings for apps which will manipulate RPM packages8 newt-python-0.52.11-3.el6.x86_64 (108 KB)newt 9 libxml2-python-2.7.6-14.el6_5.2.x86_64 (1 MB)the libxml2 library40 sos-2.2-47.el6.centos.1.noarch (717 KB) A set of tools to gather troubleshooting information from asystem1 python-ethtool-0.6-5.el6.x86_64 (68 Ethernet settings python bindings  2 yum-metadata-parser-1.1.2-16.el6.x86_64 (56 KB)A fast metadata parser for yum 3 pygpgme-0.1-18.20090824bzr68245 KB)Python module for working with OpenPGP messages4 thon-pycurl-7.19.0-8.el6.x86_64 (231 KB) A Python interface to libcurl 5 urlgrabber-3.9.1-9.el6.noarch (314 KB)high-level cross-protocol url-grabber6 dbus-python-0.83.0-6.1.el6.x86_64 (788 KB) D-Bus Python Bindings 7 python-iniparse-0.3.1-2.1.el6.noarch (106 KB)Python Module for Accessing and Modifying Configuration Data in INI files8 yum-plugin-fastestmirror-1.1.30-17.el6_5.noarch (52 KB) Yum plugin which chooses fastest repository from a mirrorlist9 3.2.29-43.el6.centos.noarch (4 MB) RPM package installer/updater/manager 50 4% libproxy-bin-0.3.0-4.el6_3.x86_64 (6 KB)Binary to test libproxy 1 0.3.0-4.el6_3.x86_64 (115 KB) A library handling all the details of proxy configuration2 python-0.3.0-4.el6_3.x86_64 (8 KB)Binding for libproxy and python 3 report-plugin-rhtsupport-2.0.9-19.el6.centos.x86_64 (73 KB) libreport's RHTSupport plugin4 ython-2.0.9-19.el6.centos.x86_64 (72 KB) Python bindings for report-libs 5 compat KB) libreport's compat layer for obsoleted 'report' package6 2.0.9-19.el6.centos.x86_64 (1 MB) Generic library for reporting various problems 7  libreport-plugin-reportuploader-2.0.9-19.el6.centos.x86_64 (32 KB)libreport's reportuploader plugin8 abrt-libs-2.0.8-21.el6.centos.x86_64 (24 KB)Libraries for abrt   9 2.0.8-21.el6.centos.x86_64 (706 KB) Automatic bug detection and reporting tool60 addon-ccpp-2.0.8-21.el6.centos.x86_64 (188 KB) abrt's C/C++ addon 1 python-2.0.8-21.el6.centos.x86_64 (20 KB) addon for catching and analyzing Python exceptions2 tui-2.0.8-21.el6.centos.x86_64 (15 KB) command line interface 3 libreport-plugin-kerneloops-2.0.9-19.el6.centos.x86_64 (18 KB) libreport's kerneloops reporter plugin4 abrt-addon-kerneloops-2.0.8-21.el6.centos.x86_64 (24 KB) abrt's kerneloops addon 5 libreport-plugin-mailx-2.0.9-19.el6.centos.x86_64 (31 libreport's mailx reporter plugin6 logger-2.0.9-19.el6.centos.x86_64 (22 logger reporter plugin7 cli-2.0.9-19.el6.centos.x86_64 (25 KB) libreport's command line interface 8 pixman-0.26.2-5.1.el6_5.x86_64 (544 KB) Pixel manipulation library 9 libthai-0.1.12-3.el6.x86_64 (678 KB) Thai language support routines70 5Xau-1.0.6-4.el6.x86_64 (39 KB) Sample Authorization Protocol for X1 xcb-1.8.1-1515 KB)A C binding to the X11 protocol 2 X11-1.5.0-41 MB) Core X11 protocol client library3 render-0.9.7-2.el6.x86_64 (58 KB)X.Org X11 libXrender runtime library4 ext-1.3.1-2.el6.x86_64 (87 KB) ext runtime library 5 cairo-1.8.8-3.1779 KB)A 2D graphics library 6 libXpm-3.5.10-2102 X.Org X11 libXpm runtime library7 t-1.1.3-1.el6.x86_64 (465 KB) t runtime library 8 fixes-5.0-3.el6.x86_64 (43 KB) Fixes library 9 mu-1.1.1-2.el6.x86_64 (15.Org X11 libXmu/libXmuu runtime libraries80 gd-2.0.35-11.el6.x86_64 (535 KB) A graphics library for quick creation of PNG or JPEG images1 libXft-2.3.1-2.el6.x86_64 (115 KB)X.Org X11 libXft runtime library 2 pango-1.28.1-7.el6_3.x86_64 (1014 KB)System for layout and rendering of internationalized text3 tk-8.5.7-5.el6.x86_64 (3 MB) The graphical toolkit for the Tcl scripting language 4 6% libXaw-1.0.11-2.el6.x86_64 (467 KB)X Athena Widget Set 5 damage-1.1.3-4.el6.x86_64 (24 KB)Damage extension library6 cursor13-6.20130524git8f677eaea.el6.x86_64 (40 KB) Cursor management library7 randr-1.4.0-1.el6.x86_64 (79 KB) X.Org X11 libXrandr runtime library 8 inerama-1.1.2-2.el6.x86_64 (32 KB)inerama runtime library9 -1.6.1-3.el6.x86_64 (63 KB)  runtime library 90 environment-modules-3.2.10-1.el6_5.x86_64 (207 KB)Provides dynamic modification of a user's environment1 openmpi-1.5.4-2.el6.x86_64 (7 MB) Open Message Passing Interface 2 7% libXcomposite-0.4.3-4.el6.x86_64 (31 KB)X Composite Extension library 3 gtk2-2.20.1-4.el6.x86_64 (12 MB) The GIMP ToolKit (GTK+), a library for creating GUIs for X4 8libfprint-0.1.0-19.pre2.el6.x86_64 (260 KB)ool kit for fingerprint scanner 5 fprintd-0.1-21.git04fd09cfa.el6.x86_64 (105 KB)D-Bus service for Fingerprint reader access6 graphviz-2.26.0-10.el6.x86_64 (2 MB) Graph Visualization Tools 7 9% tcl-2.26.0-10.el6.x86_64 (1 MB)Tcl extension & tools for graphviz8 busybox-1.15.1-20.el6.x86_64 (1 MB) Statically linked binary providing simplified versions of system commands9 kbd-misc-1.15-11.el6.noarch (1 MB) Data for kbd package  300 centos-release-6-5.el6.centos.11.2.x86_64 (32 KB)CentOS release file 1 policycoreutils-2.0.83-19.39.el6.x86_64 (3 MB) SELinux policy core utilities2 60 iptables-1.4.7-11.el6.x86_64 (835 KB) Tools for managing Linux kernel packet filtering capabilities3 route-2.6.32-32.el6_5.x86_64 (927 KB)Advanced IP routing and network device configuration tools 4 utils-20071127-17.el6_4.2.x86_64 (292 KB)Network monitoring tools including ping 5 util-linux-ng-2.17.2-12.14.el6_5.x86_64 (5 MB)A collection of basic system utilities 6 1initscripts-9.03.40-2.el6.centos.4.x86_64 (5 MB)The inittab file and the /etc/init.d scripts7 udev-147-2.51.el6.x86_64 (1 MB) A userspace implementation of devfs 8 2 device-mapper-libs-1.02.79-8.el6.x86_64 (237 KB)Device-mapper shared library 9 1.02.79-8.el6.x86_64 (172 KB)  utility 10 event-libs-1.02.79-8.el6.x86_64 (21 KB) -event daemon shared library1 1.02.79-8.el6.x86_64 (32 KB)  2 kpartx-0.4.9-72.el6_5.4.x86_64 (32 KB) Partition device manager for device-mapper devices3 bd-1.15-11.el6.x86_64 (968 KB) Tools for configuring the console (keyboard, virtual terminals, etc.)4 openssh-5.3p1-94.el6.x86_64 (721 KB)An open source implementation of SSH protocol versions 1 and 2  5 usermode-1.102-379 Tools for certain user account management tasks 6 dmraid-1.0.0.rc16-11.el6.x86_64 (330 KB)dmraid (Device-mapper RAID tool and library) 7 events-1.0.0.rc16-11.el6.x86_64 (8 KB)event_tool (Device-mapper event tool) and DSO8 lvm2-libs-2.02.100-8.el6.x86_64 (1 MB) Shared libraries for lvm2 9 cryptsetup-luks-libs-1.2.0-7.el6.x86_64 (92 KB)Cryptsetup shared library20 1.2.0-7.el6.x86_64 (295 KB) A utility for setting up encrypted filesystems1 pm-utils-1.2.5-10.el6_5.1.x86_64 (254 KB) Power management utilities and scripts 2 hal-info-20090716-3.1.el6.noarch (309 Device information files for HAL 3 0.5.14-11.el6.x86_64 (1 MB) Hardware Abstraction Layer 4 3mdadm-3.2.6-7.el6_5.2.x86_64 (846 KB)The mdadm program controls Linux md devices (software RAIDarrays)5 libdrm-2.4.45-2.el6.x86_64 (265 KB) Direct Rendering Manager runtime library  6 plymouth-0.8.3-27.el6.centos.1.x86_64 (189 KB)Graphical Boot Animation and Logger 7 dracut-004-336.el6_5.2.noarch (251 KB) Initramfs generator using udev 8 libmlx4-1.0.5-4.el6.1.x86_64 (49 KB) Mellanox ConnectX InfiniBand HCA Userspace Driver9 dracut-kernel-004-336.el6_5.2.noarch (202 Bytes)tapackage to build generic initramfs with dracut with onlykernel modules30 crda-1.1.1_2010.11.22-1.el6.x86_64 (30 KB) Regulatory compliance daemon for 802.11 wireless networking  1 wireless-tools-29-5.1.206 KB)Wireless ethernet configuration tools 2 python-iwlib-0.1-1.2.el6.x86_64 (26 KB) settings python bindings 3 rsyslog-5.8.10-8.el6.x86_64 (2 MB) Enhanced system logging and kernel message trapping daemons4 ntpdate-4.2.6p5-1.el6.centos.x86_64 (118 KB)Utility to set the date and time via NTP 5 cyrus-sasl-2.1.23-13.el6_3.129 The Cyrus SASL library 6 postfix-2.6.6-6.el6_5.x86_64 (9 MB) Postfix Mail Transport Agent7 4 crontabs-1.10-33.el6.noarch (2 KB) Root crontab files used to schedule the execution of programs8 ie-anacron-1.4.4-12.el6.x86_64 (42 KB)Utility for running regular jobs 9 1.4.4-12.el6.x86_64 (174 KB) Cron daemon for executing programs at set times40 iptables-ipv6-1.4.7-11.el6.x86_64 (185 KB)IPv6 support for iptables 1 system-config-firewall-base-1.2.27-5.el6.noarch (2 MB) system-config-firewall base components and command line tool2 5 elinux-policy-3.7.19-231.el6_5.3.noarch (8 MB) SELinux policy configuration 3 6dhcp-common-4.1.1-38.P1.el6.centos.x86_64 (193 KB)Common files used by ISC dhcp client and server4  kernel-firmware-2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 (21 MB)Firmware files used by the Linux kernel5 9   kernel-2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 (120 │ The Linux kernel│ 6 84 systemtap-runtime-2.3-4.el6_5.x86_64 (561 KB) Programmable system-wide instrumentation system - runtime 7 5 irqbalance-1.0.4-9.el6_5.x86_64 (65 KB) IRQ balancing daemon 8 pcmciautils-015-4.2.el6.x86_64 (103 PCMCIA utilities and initialization programs9 dhclient-4.1.1-38.P1.el6.centos.x86_64 (610 KB)rovides the dhclient ISC DHCP client daemon and dhclient-script 50 selinux-policy-targeted-3.7.19-231.el6_5.3.noarch (3 MB) SELinux targeted base policy1 ystem-config-firewall-tui-1.2.27-5.el6.noarch (59 KB) A text interface for basic firewall setup 2 stat-9.0.4-22.el6_5.1.x86_64 (823 KB) The sar and iostat system monitoring commands3 ntp-4.2.6p5-1.el6.centos1 MB) NTP daemon and utilities 4 system-config-network-tui-1.6.0.el6.2-1.el6.noarch (4 MB) The Network Adminstration Tool5 6libibverbs-utils-1.1.7-1.el6.x86_64 (107 KB) Examples for the libibverbs library 6 kexec-tools-2.0.0-273.el6_5.1.x86_64 (848 KB)The kexec/kdump userspace component.7 lvm2-2.02.100-8.el6.x86_64 (1 MB) Userland logical volume management tools8 setuptool-1.19.9-4.el6.x86_64 (138 KB)A text mode system configuration tool 9 openssh-server-5.3p1-94.el6.x86_64 (673 KB)n open source SSH server daemon 60 clients-5.3p1-94.el6.x86_64 (1 MB) client applications1 7 parted-2.1-21.el6.x86_64 (2 MB) The GNU disk partition manipulation program2 bfa-firmware-3.2.21.1-2.el6.noarch (6 MB)Brocade Fibre Channel HBA Firmware 3 8 iwl5150-firmware-8.24.2.2-1.el6.noarch (336 KB)Firmware for Intel® Wireless 5150 A/G/N network adaptors4 100-firmware-39.31.5.1(R) Wireless WiFi Link 100 Series Adapters5 6050-firmware-41.28.5.1-2.el6.noarch (918 KB)6050 Series Adapters6 b43-openfwwf-5.2-4.el6.noarch (30 KB) Open firmware for some Broadcom 43xx series WLAN chips 7 iwl6000g2a-firmware-17.168.5.3-1.el6.noarch (440 KB) Firmware for Intel(R) Wireless WiFi Link 6005 Series Adapters8 aic94xx-firmware-30-2.el6.noarch (30 KB) Adaptec SAS 44300, 48300, 58300 Sequencer Firmware for AIC94xx driver9 iwl60009.221.4.1-1.el6.noarch (450 KB)Firmware for Intel(R) Wireless WiFi Link 6000 Series AGN Adapter  70 139.31.5663 ® PRO/Wireless 1000 B/G/N network adaptors 1 biosdevname-0.5.0-2.el6.x86_64 (52 KB) Udev helper for naming devices per BIOS names 2 rdma-3.10-3.el6.noarch (38 KB) Infiniband/iWARP Kernel Module Initializer 3 quota-3.17-21.el6_5.x86_64 (1007 KB)System administration tools for monitoring users' disk usage4 acpid-1.0.10-2.1.el6.x86_64 (72 KB) ACPI Event Daemon 5 rng-tools-2-13.el6_254 Random number generator related utilities6 eadahead-1.5.6-2.el6.x86_64 (112 KB)ead a preset list of files into memory 7 microcode_ctl-1.17-17.el6_5.1.x86_64 (1 MB)Tool to update x86/x86-64 CPU microcode.8 9cpuspeed-1.5-20.el6_4.x86_64 (63 KB) CPU frequency adjusting daemon 9 smartmontools-5.43-1.el6.x86_64 (1 MB)Tools for monitoring SMART capable hard disks80 virt-what-1.11-1.2.el6.x86_64 (36 KB) Detect if we are running in a virtual machine1 prelink-0.4.6-3.1.el6_4.x86_64 (1 MAn ELF prelinking utility 2 ibutils-1.5.7-8.el6.x86_64 (4 MB) OpenIB Mellanox InfiniBand Diagnostic Tools3 90 fprintd-pam-0.1-21.git04fd09cfa.el6.x86_64 (17 KB)PAM module for fingerprint authentication 4 metabench-1.0-1.wc2.x86_64 (60 KB) A Parallel File System Metadata Performance Benchmark5 IOR-2.10.3-wc1.x86_64 (226 KB) IOR Parallel Filesystem Benchmark 6 mdtest-1.8.3-1.wc1.x86_64 (120 KB)MPI-coordinated metadata benchmark test7 simul-1.14-1.wc1.x86_64 (57 KB) test for parallel filesystems8 abrt-cli-2.0.8-21.el6.centos.x86_64 (0 Bytes)Virtual package to install all necessary packages for usage from command line environment9 yum-plugin-security-1.1.30-17.el6_5.noarch (78 KB)Yum plugin to enable security filters  90 utils-1.1.30-17.el6_5.noarch (301 KB) Utilities based around the yum package manager1 authconfig-6.1.12-13.el6.x86_64 (1 MB) Command line tool for setting up authentication from networkservices2 vim-enhanced-7.2.411-1.8.el6.x86_64 (1 MB)A version of the VIM editor which includes recent enhancements  3 grub-0.97-84.el6_5.x86_64 (2 MB) Grand Unified Boot Loader. 4 blktrace-1.0.1-6.el6.x86_64 (1017 KB)Utilities for performing block layer IO tracing in the linuxkernel5 1 ntsysv-1.3.49.3-2.el6_4.1.x86_64 (26 KB)A tool to set the stop/start of system services in a runlevel 6 bind-utils-9.8.2-0.23.rc1.el6_5.1.x86_64 (437 KB)Utilities for querying DNS name servers 7 rubygem-chef-0.9.14-1.wc7.noarch (1 MB) A systems integration framework, built to bring the benefits of configuration management to your entire infrastructure8 man-pages-overrides-6.5.3-1.el6_5.noarch (1 MB)Complementary and updated manual pages  9 wget-1.12-1.11.el6_5.x86_64 (1 MB) A utility for retrieving files using the HTTP or FTP protocols 400 tcpdump-4.0.0-3.20090921gitdf3cb4.2.el6.x86_64 (812 KB) A network traffic monitoring tool1 pdsh-2.29-1.wc1.x86_64 (583 KB) Parallel remote shell program 2 ledmon-0.78-1.el6.x86_64 (127 KB)Enclosure LED Utilities 3 sudo-1.8.6p3-12.el6.x86_64 (2 MAllows restricted root access for specified users4 2pinfo-0.6.9-12.el6.x86_64 (293 KB)n info file viewer 5 alsa-utils-1.0.22-5.el6.x86_64 (3 MB)dvanced Linux Sound Architecture (ALSA) utilities6 usbutils-003-4.el6.x86_64 (175 KB) Linux USB utilities 7 at-3.1.10-44.el6_5.2.x86_64 (91 KB)Job spooling tools 8 pam_passwdqc-1.0.5-6.el6.x86_64 (62 KB)Pluggable password quality-control module9 audit-2.2-4.el6_5.x86_64 (956 KB) User space tools for 2.6 kernel auditing 10 psacct-6.3.2-63.el6_3.3.x86_64 (137 KB)tilities for monitoring process activities1 compilebench-0.6-1.wc1.x86_64 (2 MB) Filesystem aging benchmark 2 3 hunspell-en-0.20090216-7.1.el6.noarch (1 MB)English hunspell dictionaries3 ibsim-0.5-7.el6.x86_64 (131 KB) InfiniBand fabric simulator for management4 tmpwatch-2.9.16-4.el6.x86_64 (40 KB)A utility for removing files based on when they were lastaccessed5 bonnie++-1.96-2.el6.x86_64 (159 KB) Filesystem and disk benchmark & burn-in suite  6 mlocate-0.22.2-4.el6.x86_64 (279 KB)An utility for finding files by name 7 librdmacm-utils-1.0.17-1.el6.x86_64 (163 KB)Examples for the librdmacm library 8 dapl-2.0.34-1.el6.x86_64 (631 KB) Library providing access to the DAT 2.0 API9 efibootmgr-0.5.4-11.el6.x86_64 (70 KB)EFI Boot Manager 20 cyrus-sasl-plain-2.1.23-13.el6_3.1.x86_64 (36 KB)PLAIN and LOGIN authentication support for Cyrus SASL1 ibacm-1.0.8-0.git7a3adb7.el6.x86_64 (109 KB) InfiniBand Communication Manager Assistant 2 unzip-6.0-1.el6.x86_64 (312 KB) A utility for unpacking zip files 3 lsof-4.82-4890 which lists open files on a Linux/UNIX system4 ibibcm-1.0.5-3.el6.x86_64 (35 KB)Userspace InfiniBand Connection Manager 5 pathverbs-1.2-4.el6.x86_64 (17 KB)QLogic InfiniPath HCA Userspace Driver 6 mthca-1.0.6-3.el6.x86_64 (66 KB) Mellanox InfiniBand HCA Userspace Driver7 nes-1.1.3-1.el6.x86_64 (21 KB) NetEffect RNIC Userspace Driver 8 cxgb3-1.3.1-1.el6.x86_64 (22 KB)Chelsio T3 iWARP HCA Userspace Driver9 rsync-3.0.6-9.el6_4.1.x86_64 (682 KB)A program for synchronizing files over a network30 dbench-4.0-4.el6.x86_64 (25 MB) Filesystem load benchmarking tool 1 7 ed-1.1-3.3.el6.x86_64 (117 KB) The GNU line editor 2 nano-2.0.9-7.el6.x86_64 (1 MA small text 3 time-1.7-37.1.el6.x86_64 (38 KB)GNU utility for monitoring a program's use of system resources 4 attr-2.4.44-7138 KB)Utilities for managing filesystem extended attributes 5 scl-utils-20120927-8.el6.x86_64 (14 KB)alternative packaging 6 iozone-3-373.wc1.x86_64 (1 MB) Iozone Filesystem Benchmark 7 fdtree-1.0.2-1.wc1.x86_64 (31 KB)Benchmark for testing the metadata performance of a file system 8 mtr-0.75-5.el6.x86_64 (96 KB) A network diagnostic tool 9 traceroute-2.0.14-2.el6.x86_64 (79 KB)Traces the route taken by packets over an IPv4/IPv6 network40 setserial-2.17-25.el6.x86_64 (30 KB) A utility for configuring serial ports 1 vconfig-1.9-8.1.el6.x86_64 (177 KB) Linux 802.1q VLAN configuration utility2 zip-3.0-1.el6.x86_64 (804 KB) A file compression and packaging utility compatible with PKZIP 3 dosfstools-3.0.9-4.el6.x86_64 (196 KB)Utilities for making and checking MS-DOS FAT filesystems on Linux 4 rfkill-0.3-4.el6.x86_64 (10 KB) A tool for enabling and disabling wireless devices 5 date-1.4-1628 Tool for getting the date/time from a remote machine6 bridge-utils-1.2-10.el6.x86_64 (57 KB)Utilities for configuring the linux ethernet bridge 7 eject-2.1.5-17.el6.x86_64 (133 KB) A program that ejects removable media using software control8 strace-4.5.19-1.17.el6.x86_64 (533 KB)Tracks and displays system calls associated with a running process9 b43-fwcutter-012-2.2.el6.x86_64 (29 KB)Firmware extraction tool for Broadcom wireless driver  50 rds-tools-2.0.6-3.el6.x86_64 (110 KB) RDS support tools 1 connectathon-1.0-1.wc1.x86_64 (685 KB)The Connectathon NFS Testsuite2 8pdsh-rcmd-rsh-2.29-1.wc1.x86_64 (22 KB)Provides bsd rcmd capability to pdsh3 fsx-1.0-1.wc1.x86_64 (28 KB) The File System eXerciser 4 pdsh-rcmd-ssh-2.29-1.wc1.x86_64 (24 KB)Provides ssh rcmd capability to pdsh5 man-pages-3.22-20.el6.noarch (4 MB) Man (manual) pages from the Linux Documentation Project6 words-3.0-17.el6.noarch (4 MB) A dictionary of English words for the /usr/share/dict directory 7 9 centos-indexhtml-6-1.el6.centos.noarch (69 KB)Browser default start page for CentOS 8 ql2400-firmware-7.03.00-1.el6_5256 KB)Firmware for qlogic 2400 devices 9 iwl5000-firmware-8.83.5.1_1-1.el6_1.1.noarch (1021 KB) Intel® PRO/Wireless 5000 A/G/N network adaptors60 ql2100-firmware-1.19.38-3.1.el6.noarch (76 KB) qlogic 2100 devices 1 ivtv-firmware-20080701-20.2.noarch (837 KB) the Hauppauge PVR 250/350/150/500/USB2 model series 2 libertas-usb8388-firmware-5.110.22.p23-3.1.el6.noarch (126 KB) Firmware for Marvell Libertas USB 8388 Network Adapter3 xorg-x11-drv-ati7.1.0-3.el6.noarch (575 KB) ATI firmware for R600/700/Evergreen/NI/PALM 4 ql2500-firmware-7.03.00-1.el6_5.noarch (262 KB) Firmware for qlogic 2500 devices 5 atmel-firmware-1.3-7.el6.noarch (711 KB) Atmel at76c50x wireless network chips6 zd1211-firmware-1.4-4.el6.noarch (63 wireless devices based on zd1211 chipset7 iwl4965-firmware-228.61.2.24-2.1.el6.noarch (373 KB) Intel® PRO/Wireless 4965 A/G/N network adaptors8 rt61pci1.2-7.el6.noarch (26 KB) Ralink® RT2561/RT2661 A/B/G network adaptors 9 iwl39455.32.2.9-4.el6.noarch (446 KB)Intel® PRO/Wireless 3945 A/B/G network adaptors70 ql2200-firmware-2.02.08-3.1.el6.noarch (84 KB) qlogic 2200 devices 1 rt73usb-firmware-1.8-7.el6.noarch (4 KB) Ralink® RT2571W/RT2671 A/B/G network adaptors2 ipw21003-11.el6.noarch (604 KB)Intel® PRO/Wireless 2100 network adaptors 3 ql23xx-firmware-3.03.27-3.1.el6.noarch (256 KB)qlogic 23xx devices 4 ipw2200-firmware-3.1-4.el6.noarch (562 KB) Intel® PRO/Wireless 2200 network adaptors5 100 rootfiles-8.1-6.1.el6.noarch (599 Bytes) The basic required files for the root user's directory6               ┌───────────┤ Post Installation ├────────────┐ ││ │ Performing post-installation configuration │ ││ └────────────────────────────────────────────┘      ┌─────┤ Bootloader ├─────┐ ││ │ Installing bootloader. │ ││ └────────────────────────┘      ┌───────┤ Post-Installation ├───────┐ ││ │ Running post-installation scripts │ ││ └───────────────────────────────────┘ (B)0Welcome to CentOS for x86_64 ┌───────┤ Post-Installation ├───────┐ ││ │ Running post-installation scripts │ ││ └───────────────────────────────────┘/ between elements | selects | next screen      terminating anaconda...done sending termination signals...done sending kill signals...done disabling swap... /dev/vda2 unmounting filesystems... /mnt/runtime done disabling /dev/loop0 /dev/pts done /selinux done /mnt/sysimage/dev/pts done /mnt/sysimage/dev/shm done /mnt/sysimage/dev done /mnt/sysimage/proc/bus/usb done /mnt/sysimage/proc done /mnt/sysimage/sys done /mnt/sysimage/selinux done /mnt/sysimage done waiting for mdraid sets to become clean... rebooting system Restarting system. Press any key to continue. Press any key to continue. Press any key to continue. Press any key to continue. Press any key to continue.  GNU GRUB version 0.97 (631K lower / 2096116K upper memory) +-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+ Use the ^ and v keys to select which entry is highlighted. Press enter to boot the selected OS, 'e' to edit the commands before booting, 'a' to modify the kernel arguments before booting, or 'c' for a command-line.  CentOS (2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64)             The highlighted entry will be booted automatically in 5 seconds. The highlighted entry will be booted automatically in 4 seconds. The highlighted entry will be booted automatically in 3 seconds. The highlighted entry will be booted automatically in 2 seconds. The highlighted entry will be booted automatically in 1 seconds. Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 (jenkins@onyx-8-sde1-el6-x8664.onyx.hpdd.intel.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Tue Oct 7 07:21:59 PDT 2014 Command line: ro root=UUID=70dc2267-b901-4ea6-b6c4-951e9a20e152 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=tty0 crashkernel=auto SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM console=ttyS0,115200 KERNEL supported cpus: Intel GenuineIntel AMD AuthenticAMD Centaur CentaurHauls BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009dc00 (usable) BIOS-e820: 000000000009dc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 000000007fffd000 (usable) BIOS-e820: 000000007fffd000 - 0000000080000000 (reserved) BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved) DMI 2.4 present. SMBIOS version 2.4 @ 0xFDA30 Hypervisor detected: KVM last_pfn = 0x7fffd max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x70406, new 0x7010600070106 init_memory_mapping: 0000000000000000-000000007fffd000 RAMDISK: 36b79000 - 37fef53a ACPI: RSDP 00000000000fda00 00014 (v00 BOCHS ) ACPI: RSDT 000000007fffd670 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) ACPI: FACP 000000007ffffe40 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) ACPI: DSDT 000000007fffd950 024A2 (v01 BXPC BXDSDT 00000001 INTL 20090123) ACPI: FACS 000000007ffffe00 00040 ACPI: SSDT 000000007fffd8b0 0009E (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001) ACPI: APIC 000000007fffd7c0 00078 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) ACPI: SSDT 000000007fffd6b0 0010F (v01 BXPC BXSSDTPC 00000001 INTL 20090123) Setting APIC routing to flat. No NUMA configuration found Faking a node at 0000000000000000-000000007fffd000 Bootmem setup node 0 0000000000000000-000000007fffd000 NODE_DATA [000000000000a000 - 000000000003dfff] bootmap [000000000003e000 - 000000000004dfff] pages 10 (7 early reservations) ==> bootmem [0000000000 - 007fffd000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #2 [0001000000 - 0002020aa4] TEXT DATA BSS ==> [0001000000 - 0002020aa4] #3 [0036b79000 - 0037fef53a] RAMDISK ==> [0036b79000 - 0037fef53a] #4 [000009dc00 - 0000100000] BIOS reserved ==> [000009dc00 - 0000100000] #5 [0002021000 - 0002021081] BRK ==> [0002021000 - 0002021081] #6 [0000008000 - 000000a000] PGTABLE ==> [0000008000 - 000000a000] found SMP MP-table at [ffff8800000fda50] fda50 Reserving 129MB of memory at 48MB for crashkernel (System RAM: 2047MB) kvm-clock: Using msrs 4b564d01 and 4b564d00 kvm-clock: cpu 0, msr 0:1c24801, boot clock Zone PFN ranges: DMA 0x00000001 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal 0x00100000 -> 0x00100000 Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000001 -> 0x0000009d 0: 0x00000100 -> 0x0007fffd ACPI: PM-Timer IO Port: 0xb008 Setting APIC routing to flat. ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Using ACPI (MADT) for SMP configuration information SMP: Allowing 1 CPUs, 0 hotplug CPUs PM: Registered nosave memory: 000000000009d000 - 000000000009e000 PM: Registered nosave memory: 000000000009e000 - 00000000000a0000 PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000 PM: Registered nosave memory: 00000000000f0000 - 0000000000100000 Allocating PCI resources starting at 80000000 (gap: 80000000:7ffbc000) Booting paravirtualized kernel on KVM NR_CPUS:4096 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 PERCPU: Embedded 31 pages/cpu @ffff880002200000 s94936 r8192 d23848 u2097152 pcpu-alloc: s94936 r8192 d23848 u2097152 alloc=1*2097152 pcpu-alloc: [0] 0 kvm-clock: cpu 0, msr 0:2216801, primary cpu clock kvm-stealtime: cpu 0, msr 220e880 Built 1 zonelists in Node order, mobility grouping on. Total pages: 516914 Policy zone: DMA32 Kernel command line: ro root=UUID=70dc2267-b901-4ea6-b6c4-951e9a20e152 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=tty0 crashkernel=129M@0M SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM console=ttyS0,115200 PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found AMD-Vi disabled by default: pass amd_iommu=on to enable Memory: 1897868k/2097140k available (5332k kernel code, 400k absent, 198872k reserved, 7006k data, 1280k init) Hierarchical RCU implementation. NR_IRQS:33024 nr_irqs:256 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled allocated 8388608 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Detected 2000.138 MHz processor. Calibrating delay loop (skipped) preset value.. 4000.27 BogoMIPS (lpj=2000138) pid_max: default: 32768 minimum: 301 Security Framework initialized SELinux: Initializing. Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes) Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys devices Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys blkio Initializing cgroup subsys perf_event Initializing cgroup subsys net_prio mce: CPU supports 10 MCE banks alternatives: switching to unfair spinlock SMP alternatives: switching to UP code Freeing SMP alternatives: 36k freed ACPI: Core revision 20090903 ftrace: converting mcount calls to 0f 1f 44 00 00 ftrace: allocating 21794 entries in 86 pages APIC routing finalized to flat. ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: AMD QEMU Virtual CPU version (cpu64-rhel6) stepping 03 Performance Events: Broken PMU hardware detected, using software events only. NMI watchdog disabled (cpu0): hardware events not enabled Brought up 1 CPUs Total of 1 processors activated (4000.27 BogoMIPS). devtmpfs: initialized regulator: core version 0.5 NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using configuration type 1 for base access bio: create slab at 0 ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing ACPI: No dock devices found. PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) PCI host bridge to bus 0000:00 pci_bus 0000:00: root bus resource [io 0x0000-0xffff] pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffffffff] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) ACPI: PCI Interrupt Link [LNKS] (IRQs *9) vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded vgaarb: bridge control possible 0000:00:02.0 SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default Switching to clocksource kvm-clock pnp: PnP ACPI init ACPI: bus type pnp registered pnp: PnP ACPI: found 6 devices ACPI: ACPI bus type pnp unregistered NET: Registered protocol family 2 IP route cache hash table entries: 65536 (order: 7, 524288 bytes) TCP established hash table entries: 262144 (order: 10, 4194304 bytes) TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) TCP: Hash tables configured (established 262144 bind 65536) TCP reno registered NET: Registered protocol family 1 pci 0000:00:00.0: Limiting direct PCI/PCI transfers pci 0000:00:01.0: PIIX3: Enabling Passive Release pci 0000:00:01.0: Activating ISA DMA hang workarounds ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11 pci 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 pci 0000:00:01.2: PCI INT D disabled Trying to unpack rootfs image as initramfs... Freeing initrd memory: 20953k freed audit: initializing netlink socket (disabled) type=2000 audit(1414387670.739:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) msgmni has been set to 3747 alg: No test for stdrng (krng) ksign: Installing public key data Loading keyring - Added public key 3B887A80AE5E5B8D - User ID: Red Hat, Inc. (Kernel Module GPG key) - Added public key D4A26C9CCD09BEDA - User ID: Red Hat Enterprise Linux Driver Update Program Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered (default) io scheduler cfq registered pci_hotplug: PCI Hot Plug PCI Core version: 0.5 pciehp: PCI Express Hot Plug Controller Driver version: 0.4 acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 acpiphp: Slot [1] registered acpiphp: Slot [2] registered acpiphp: Slot [3] registered acpiphp: Slot [4] registered acpiphp: Slot [5] registered acpiphp: Slot [6] registered acpiphp: Slot [7] registered acpiphp: Slot [8] registered acpiphp: Slot [9] registered acpiphp: Slot [10] registered acpiphp: Slot [11] registered acpiphp: Slot [12] registered acpiphp: Slot [13] registered acpiphp: Slot [14] registered acpiphp: Slot [15] registered acpiphp: Slot [16] registered acpiphp: Slot [17] registered acpiphp: Slot [18] registered acpiphp: Slot [19] registered acpiphp: Slot [20] registered acpiphp: Slot [21] registered acpiphp: Slot [22] registered acpiphp: Slot [23] registered acpiphp: Slot [24] registered acpiphp: Slot [25] registered acpiphp: Slot [26] registered acpiphp: Slot [27] registered acpiphp: Slot [28] registered acpiphp: Slot [29] registered acpiphp: Slot [30] registered acpiphp: Slot [31] registered ipmi message handler version 39.2 IPMI System Interface driver. ipmi_si: Adding default-specified kcs state machine ipmi_si: Trying default-specified kcs state machine at i/o address 0xca2, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Adding default-specified smic state machine ipmi_si: Trying default-specified smic state machine at i/o address 0xca9, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Adding default-specified bt state machine ipmi_si: Trying default-specified bt state machine at i/o address 0xe4, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Unable to find any System Interface(s) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] [Firmware Bug]: No valid trip found GHES: HEST is not enabled! Non-volatile memory driver v1.3 Linux agpgart interface v0.103 crash memory driver: version 1.1 Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled erial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A brd: module loaded loop: module loaded input: Macintosh mouse button emulation as /devices/virtual/input/input1 Fixed MDIO Bus: probed ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver uhci_hcd: USB Universal Host Controller Interface driver uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 uhci_hcd 0000:00:01.2: UHCI Host Controller uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020 usb usb1: New USB device found, idVendor=1d6b, idProduct=0001 usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 usb usb1: Product: UHCI Host Controller usb usb1: Manufacturer: Linux 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 uhci_hcd usb usb1: SerialNumber: 0000:00:01.2 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mice: PS/2 mouse device common for all mice input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2 rtc_cmos 00:01: RTC can wake from S4 rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 rtc0: alarms up to one day, 114 bytes nvram cpuidle: using governor ladder cpuidle: using governor menu EFI Variables Facility v0.08 2004-May-17 usbcore: registered new interface driver hiddev usbcore: registered new interface driver usbhid usbhid: v2.6:USB HID core driver GRE over IPv4 demultiplexor driver TCP cubic registered Initializing XFRM netlink socket NET: Registered protocol family 17 registered taskstats version 1 rtc_cmos 00:01: setting system clock to 2014-10-27 05:27:52 UTC (1414387672) Initalizing network drop monitor service Freeing unused kernel memory: 1280k freed Write protecting the kernel read-only data: 10240k Freeing unused kernel memory: 792k freed Freeing unused kernel memory: 1584k freed dracut: dracut-004-336.el6_5.2 dracut: rd_NO_LUKS: removing cryptoluks activation dracut: rd_NO_LVM: removing LVM activation device-mapper: uevent: version 1.0.3 device-mapper: ioctl: 4.24.6-ioctl (2013-01-15) initialised: dm-devel@redhat.com udev: starting version 147 dracut: Starting plymouth daemon dracut: rd_NO_DM: removing DM RAID activation dracut: rd_NO_MD: removing MD RAID activation scsi0 : ata_piix scsi1 : ata_piix ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc000 irq 14 ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc008 irq 15 Refined TSC clocksource calibration: 2000.177 MHz. input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3 virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10 %G vda: vda1 vda2 kjournald starting. Commit interval 5 seconds EXT3-fs (vda1): mounted filesystem with ordered data mode dracut: Mounted root filesystem /dev/vda1 SELinux: Disabled at runtime. type=1404 audit(1414387673.767:2): selinux=0 auid=4294967295 ses=4294967295 dracut: dracut: Switching root Welcome to CentOS Starting udev: udev: starting version 147 piix4_smbus 0000:00:01.3: SMBus Host Controller at 0xb100, revision 0 8139cp: 10/100 PCI Ethernet driver v1.3 (Mar 22, 2004) ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11 8139cp 0000:00:03.0: PCI INT A -> Link[LNKC] -> GSI 11 (level, high) -> IRQ 11 eth0: RTL-8139C+ at 0xffffc900009d4000, 00:16:3e:18:6e:86, IRQ 11 8139too Fast Ethernet driver 0.9.28 %Gplatform microcode: firmware: requesting amd-ucode/microcode_amd.bin microcode: CPU0: AMD CPU family 0x6 not supported Microcode Update Driver: v2.00 , Peter Oruba [ OK ] Setting hostname eagle-44vm1.eagle.hpdd.intel.com: [ OK ] Setting up Logical Volume Management: No volume groups found [ OK ] Checking filesystems Checking all file systems. [/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/vda1 /dev/vda1: clean, 42687/1310720 files, 542622/5242880 blocks [ OK ] Remounting root filesystem in read-write mode: EXT3-fs (vda1): using internal journal [ OK ] Mounting local filesystems: [ OK ] Enabling local filesystem quotas: [ OK ] Enabling /etc/fstab swaps: Adding 4128764k swap on /dev/vda2. Priority:-1 extents:1 across:4128764k [ OK ] Entering non-interactive startup Calling the system activity data collector (sadc)... Loading OpenIB kernel modules:NET: Registered protocol family 10 lo: Disabled Privacy Extensions [ OK ] Bringing up loopback interface: [ OK ] Bringing up interface eth0: Determining IP information for eth0...eth0: link up, 100Mbps, full-duplex, lpa 0x05E1 connect: Invalid argument done. [ OK ] Starting auditd: [ OK ] Starting system logger: [ OK ] Starting irqbalance: [ OK ] Starting rpcbind: [ OK ] Starting sssd: [ OK ] [ OK ] Starting NFS statd: [ OK ] No kdump initial ramdisk found.[WARNING] Rebuilding /boot/initrd-2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64kdump.img RPC: Registered named UNIX socket transport module. RPC: Registered udp transport module. RPC: Registered tcp transport module. RPC: Registered tcp NFSv4.1 backchannel transport module. Slow work thread pool: Starting up Slow work thread pool: Ready FS-Cache: Loaded NFS: Registering the id_resolver key type FS-Cache: Netfs 'nfs' registered for caching mount.nfs: mounting 10.100.0.2:/export/scratch/dumps failed, reason given by server: No such file or directory /etc/kdump.conf: Bad NFS mount eagle-2.eagle.hpdd.intel.com:/export/scratch/dumps Failed to run mkdumprd Starting system message bus: [ OK ] Starting ibacm daemon:[ OK ] Mounting filesystems: [ OK ] Starting acpi daemon: [ OK ] Starting HAL daemon: [ OK ] Retrigger failed udev events[ OK ] Loading autofs4: [ OK ] Starting automount: [ OK ] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). Starting NFS services: [ OK ] Starting NFS quotas: [ OK ] Starting NFS mountd: [ OK ] Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory NFSD: starting 90-second grace period [ OK ] Starting RPC idmapd: [ OK ] Starting MUNGE: munged[ OK ] Generating SSH1 RSA host key: [ OK ] Generating SSH2 RSA host key: [ OK ] Generating SSH2 DSA host key: [ OK ] Starting sshd: [ OK ] Starting xinetd: [ OK ] Starting ntpd: [ OK ] Starting postfix: [ OK ] Starting crond: [ OK ] Starting atd: [ OK ] Starting certmonger: [ OK ] CentOS release 6.5 (Final) Kernel 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 on an x86_64 eagle-44vm1.eagle.hpdd.intel.com login: Stopping certmonger: [ OK ] Stopping atd: [ OK ] Stopping sshd: [ OK ] Shutting down postfix: [ OK ] Stopping xinetd: [ OK ] Stopping crond: [ OK ] Shutting down NFS daemon: [ OK ] Shutting down NFS mountd: nfsd: last server has exited, flushing export cache [ OK ] Shutting down NFS quotas: [ OK ] Shutting down RPC idmapd: [ OK ] Stopping automount: [ OK ] Stopping acpi daemon: [ OK ] Stopping HAL daemon: [ OK ] Shutting down ntpd: [ OK ] Stopping block device availability: Deactivating block devices: [ OK ] Stopping ibacm daemon:[FAILED] Stopping system message bus: [ OK ] Stopping rpcbind: [ OK ] Stopping auditd: type=1305 audit(1414388329.163:116): audit_pid=0 old=1011 auid=4294967295 ses=4294967295 res=1 [ OK ] type=1305 audit(1414388329.262:117): audit_enabled=0 old=1 auid=4294967295 ses=4294967295 res=1 Shutting down system logger: [ OK ] Stopping sssd: [ OK ] Shutting down interface eth0: [ OK ] Shutting down loopback interface: [ OK ] Unloading OpenIB kernel modules:[ OK ] Sending all processes the TERM signal... [ OK ] Sending all processes the KILL signal... [ OK ] Saving random seed: [ OK ] Syncing hardware clock to system time [ OK ] Turning off swap: [ OK ] Turning off quotas: [ OK ] Unmounting pipe file systems: [ OK ] init: Re-executing /sbin/init Please stand by while rebooting the system... Restarting system. machine restart Press any key to continue. Press any key to continue. Press any key to continue. Press any key to continue. Press any key to continue.  GNU GRUB version 0.97 (631K lower / 2096116K upper memory) +-------------------------------------------------------------------------+||||||||||||||||||||||||+-------------------------------------------------------------------------+ Use the ^ and v keys to select which entry is highlighted. Press enter to boot the selected OS, 'e' to edit the commands before booting, 'a' to modify the kernel arguments before booting, or 'c' for a command-line.  CentOS (2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64)             The highlighted entry will be booted automatically in 5 seconds. The highlighted entry will be booted automatically in 4 seconds. The highlighted entry will be booted automatically in 3 seconds. The highlighted entry will be booted automatically in 2 seconds. The highlighted entry will be booted automatically in 1 seconds. Initializing cgroup subsys cpuset Initializing cgroup subsys cpu Linux version 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 (jenkins@onyx-8-sde1-el6-x8664.onyx.hpdd.intel.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Tue Oct 7 07:21:59 PDT 2014 Command line: ro root=UUID=70dc2267-b901-4ea6-b6c4-951e9a20e152 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=tty0 crashkernel=auto SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM console=ttyS0,115200 KERNEL supported cpus: Intel GenuineIntel AMD AuthenticAMD Centaur CentaurHauls BIOS-provided physical RAM map: BIOS-e820: 0000000000000000 - 000000000009dc00 (usable) BIOS-e820: 000000000009dc00 - 00000000000a0000 (reserved) BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved) BIOS-e820: 0000000000100000 - 000000007fffd000 (usable) BIOS-e820: 000000007fffd000 - 0000000080000000 (reserved) BIOS-e820: 00000000fffbc000 - 0000000100000000 (reserved) DMI 2.4 present. SMBIOS version 2.4 @ 0xFDA30 Hypervisor detected: KVM last_pfn = 0x7fffd max_arch_pfn = 0x400000000 x86 PAT enabled: cpu 0, old 0x70406, new 0x7010600070106 init_memory_mapping: 0000000000000000-000000007fffd000 RAMDISK: 36aaf000 - 37fef64f ACPI: RSDP 00000000000fda00 00014 (v00 BOCHS ) ACPI: RSDT 000000007fffd670 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) ACPI: FACP 000000007ffffe40 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) ACPI: DSDT 000000007fffd950 024A2 (v01 BXPC BXDSDT 00000001 INTL 20090123) ACPI: FACS 000000007ffffe00 00040 ACPI: SSDT 000000007fffd8b0 0009E (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001) ACPI: APIC 000000007fffd7c0 00078 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) ACPI: SSDT 000000007fffd6b0 0010F (v01 BXPC BXSSDTPC 00000001 INTL 20090123) Setting APIC routing to flat. No NUMA configuration found Faking a node at 0000000000000000-000000007fffd000 Bootmem setup node 0 0000000000000000-000000007fffd000 NODE_DATA [000000000000a000 - 000000000003dfff] bootmap [000000000003e000 - 000000000004dfff] pages 10 (7 early reservations) ==> bootmem [0000000000 - 007fffd000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #2 [0001000000 - 0002020aa4] TEXT DATA BSS ==> [0001000000 - 0002020aa4] #3 [0036aaf000 - 0037fef64f] RAMDISK ==> [0036aaf000 - 0037fef64f] #4 [000009dc00 - 0000100000] BIOS reserved ==> [000009dc00 - 0000100000] #5 [0002021000 - 0002021081] BRK ==> [0002021000 - 0002021081] #6 [0000008000 - 000000a000] PGTABLE ==> [0000008000 - 000000a000] found SMP MP-table at [ffff8800000fda50] fda50 Reserving 129MB of memory at 48MB for crashkernel (System RAM: 2047MB) kvm-clock: Using msrs 4b564d01 and 4b564d00 kvm-clock: cpu 0, msr 0:1c24801, boot clock Zone PFN ranges: DMA 0x00000001 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal 0x00100000 -> 0x00100000 Movable zone start PFN for each node early_node_map[2] active PFN ranges 0: 0x00000001 -> 0x0000009d 0: 0x00000100 -> 0x0007fffd ACPI: PM-Timer IO Port: 0xb008 Setting APIC routing to flat. ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Using ACPI (MADT) for SMP configuration information SMP: Allowing 1 CPUs, 0 hotplug CPUs PM: Registered nosave memory: 000000000009d000 - 000000000009e000 PM: Registered nosave memory: 000000000009e000 - 00000000000a0000 PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000 PM: Registered nosave memory: 00000000000f0000 - 0000000000100000 Allocating PCI resources starting at 80000000 (gap: 80000000:7ffbc000) Booting paravirtualized kernel on KVM NR_CPUS:4096 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 PERCPU: Embedded 31 pages/cpu @ffff880002200000 s94936 r8192 d23848 u2097152 pcpu-alloc: s94936 r8192 d23848 u2097152 alloc=1*2097152 pcpu-alloc: [0] 0 kvm-clock: cpu 0, msr 0:2216801, primary cpu clock kvm-stealtime: cpu 0, msr 220e880 Built 1 zonelists in Node order, mobility grouping on. Total pages: 516914 Policy zone: DMA32 Kernel command line: ro root=UUID=70dc2267-b901-4ea6-b6c4-951e9a20e152 rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD console=tty0 crashkernel=129M@0M SYSFONT=latarcyrheb-sun16 KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM console=ttyS0,115200 PID hash table entries: 4096 (order: 3, 32768 bytes) Checking aperture... No AGP bridge found AMD-Vi disabled by default: pass amd_iommu=on to enable Memory: 1897060k/2097140k available (5332k kernel code, 400k absent, 199680k reserved, 7006k data, 1280k init) Hierarchical RCU implementation. NR_IRQS:33024 nr_irqs:256 Console: colour VGA+ 80x25 console [tty0] enabled console [ttyS0] enabled allocated 8388608 bytes of page_cgroup please try 'cgroup_disable=memory' option if you don't want memory cgroups Detected 2000.138 MHz processor. Calibrating delay loop (skipped) preset value.. 4000.27 BogoMIPS (lpj=2000138) pid_max: default: 32768 minimum: 301 Security Framework initialized SELinux: Initializing. Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes) Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes) Mount-cache hash table entries: 256 Initializing cgroup subsys ns Initializing cgroup subsys cpuacct Initializing cgroup subsys memory Initializing cgroup subsys devices Initializing cgroup subsys freezer Initializing cgroup subsys net_cls Initializing cgroup subsys blkio Initializing cgroup subsys perf_event Initializing cgroup subsys net_prio mce: CPU supports 10 MCE banks alternatives: switching to unfair spinlock SMP alternatives: switching to UP code Freeing SMP alternatives: 36k freed ACPI: Core revision 20090903 ftrace: converting mcount calls to 0f 1f 44 00 00 ftrace: allocating 21794 entries in 86 pages APIC routing finalized to flat. ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 CPU0: AMD QEMU Virtual CPU version (cpu64-rhel6) stepping 03 Performance Events: Broken PMU hardware detected, using software events only. NMI watchdog disabled (cpu0): hardware events not enabled Brought up 1 CPUs Total of 1 processors activated (4000.27 BogoMIPS). devtmpfs: initialized regulator: core version 0.5 NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using configuration type 1 for base access bio: create slab at 0 ACPI: Interpreter enabled ACPI: (supports S0 S5) ACPI: Using IOAPIC for interrupt routing ACPI: No dock devices found. PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) PCI host bridge to bus 0000:00 pci_bus 0000:00: root bus resource [io 0x0000-0xffff] pci_bus 0000:00: root bus resource [mem 0x00000000-0xffffffffffff] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) ACPI: PCI Interrupt Link [LNKS] (IRQs *9) vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none vgaarb: loaded vgaarb: bridge control possible 0000:00:02.0 SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb PCI: Using ACPI for IRQ routing NetLabel: Initializing NetLabel: domain hash size = 128 NetLabel: protocols = UNLABELED CIPSOv4 NetLabel: unlabeled traffic allowed by default Switching to clocksource kvm-clock pnp: PnP ACPI init ACPI: bus type pnp registered pnp: PnP ACPI: found 6 devices ACPI: ACPI bus type pnp unregistered NET: Registered protocol family 2 IP route cache hash table entries: 65536 (order: 7, 524288 bytes) TCP established hash table entries: 262144 (order: 10, 4194304 bytes) TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) TCP: Hash tables configured (established 262144 bind 65536) TCP reno registered NET: Registered protocol family 1 pci 0000:00:00.0: Limiting direct PCI/PCI transfers pci 0000:00:01.0: PIIX3: Enabling Passive Release pci 0000:00:01.0: Activating ISA DMA hang workarounds ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11 pci 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 pci 0000:00:01.2: PCI INT D disabled Trying to unpack rootfs image as initramfs... Freeing initrd memory: 21761k freed audit: initializing netlink socket (disabled) type=2000 audit(1414388356.755:1): initialized HugeTLB registered 2 MB page size, pre-allocated 0 pages VFS: Disk quotas dquot_6.5.2 Dquot-cache hash table entries: 512 (order 0, 4096 bytes) msgmni has been set to 3747 alg: No test for stdrng (krng) ksign: Installing public key data Loading keyring - Added public key 3B887A80AE5E5B8D - User ID: Red Hat, Inc. (Kernel Module GPG key) - Added public key D4A26C9CCD09BEDA - User ID: Red Hat Enterprise Linux Driver Update Program Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered (default) io scheduler cfq registered pci_hotplug: PCI Hot Plug PCI Core version: 0.5 pciehp: PCI Express Hot Plug Controller Driver version: 0.4 acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 acpiphp: Slot [1] registered acpiphp: Slot [2] registered acpiphp: Slot [3] registered acpiphp: Slot [4] registered acpiphp: Slot [5] registered acpiphp: Slot [6] registered acpiphp: Slot [7] registered acpiphp: Slot [8] registered acpiphp: Slot [9] registered acpiphp: Slot [10] registered acpiphp: Slot [11] registered acpiphp: Slot [12] registered acpiphp: Slot [13] registered acpiphp: Slot [14] registered acpiphp: Slot [15] registered acpiphp: Slot [16] registered acpiphp: Slot [17] registered acpiphp: Slot [18] registered acpiphp: Slot [19] registered acpiphp: Slot [20] registered acpiphp: Slot [21] registered acpiphp: Slot [22] registered acpiphp: Slot [23] registered acpiphp: Slot [24] registered acpiphp: Slot [25] registered acpiphp: Slot [26] registered acpiphp: Slot [27] registered acpiphp: Slot [28] registered acpiphp: Slot [29] registered acpiphp: Slot [30] registered acpiphp: Slot [31] registered ipmi message handler version 39.2 IPMI System Interface driver. ipmi_si: Adding default-specified kcs state machine ipmi_si: Trying default-specified kcs state machine at i/o address 0xca2, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Adding default-specified smic state machine ipmi_si: Trying default-specified smic state machine at i/o address 0xca9, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Adding default-specified bt state machine ipmi_si: Trying default-specified bt state machine at i/o address 0xe4, slave address 0x0, irq 0 ipmi_si: Interface detection failed ipmi_si: Unable to find any System Interface(s) input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 ACPI: Power Button [PWRF] [Firmware Bug]: No valid trip found GHES: HEST is not enabled! Non-volatile memory driver v1.3 Linux agpgart interface v0.103 crash memory driver: version 1.1 Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled erial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A brd: module loaded loop: module loaded input: Macintosh mouse button emulation as /devices/virtual/input/input1 Fixed MDIO Bus: probed ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver uhci_hcd: USB Universal Host Controller Interface driver uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 uhci_hcd 0000:00:01.2: UHCI Host Controller uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c020 usb usb1: New USB device found, idVendor=1d6b, idProduct=0001 usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 usb usb1: Product: UHCI Host Controller usb usb1: Manufacturer: Linux 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 uhci_hcd usb usb1: SerialNumber: 0000:00:01.2 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 serio: i8042 KBD port at 0x60,0x64 irq 1 serio: i8042 AUX port at 0x60,0x64 irq 12 mice: PS/2 mouse device common for all mice input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2 rtc_cmos 00:01: RTC can wake from S4 rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 rtc0: alarms up to one day, 114 bytes nvram cpuidle: using governor ladder cpuidle: using governor menu EFI Variables Facility v0.08 2004-May-17 usbcore: registered new interface driver hiddev usbcore: registered new interface driver usbhid usbhid: v2.6:USB HID core driver GRE over IPv4 demultiplexor driver TCP cubic registered Initializing XFRM netlink socket NET: Registered protocol family 17 registered taskstats version 1 rtc_cmos 00:01: setting system clock to 2014-10-27 05:39:18 UTC (1414388358) Initalizing network drop monitor service Freeing unused kernel memory: 1280k freed Write protecting the kernel read-only data: 10240k Freeing unused kernel memory: 792k freed Freeing unused kernel memory: 1584k freed dracut: dracut-004-336.el6_5.2 dracut: rd_NO_LUKS: removing cryptoluks activation dracut: rd_NO_LVM: removing LVM activation device-mapper: uevent: version 1.0.3 device-mapper: ioctl: 4.24.6-ioctl (2013-01-15) initialised: dm-devel@redhat.com udev: starting version 147 dracut: Starting plymouth daemon dracut: rd_NO_DM: removing DM RAID activation dracut: rd_NO_MD: removing MD RAID activation virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11 ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10 scsi0 : ata_piix scsi1 : ata_piix ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc000 irq 14 ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc008 irq 15 Refined TSC clocksource calibration: 2000.179 MHz. input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3 %G vda: vda1 vda2 vda3 vda4 kjournald starting. Commit interval 5 seconds EXT3-fs (vda1): mounted filesystem with ordered data mode dracut: Mounted root filesystem /dev/vda1 SELinux: Disabled at runtime. type=1404 audit(1414388359.692:2): selinux=0 auid=4294967295 ses=4294967295 dracut: dracut: Switching root Welcome to CentOS Starting udev: udev: starting version 147 piix4_smbus 0000:00:01.3: SMBus Host Controller at 0xb100, revision 0 8139cp: 10/100 PCI Ethernet driver v1.3 (Mar 22, 2004) ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11 8139cp 0000:00:03.0: PCI INT A -> Link[LNKC] -> GSI 11 (level, high) -> IRQ 11 eth0: RTL-8139C+ at 0xffffc900009d4000, 00:16:3e:18:6e:86, IRQ 11 8139too Fast Ethernet driver 0.9.28 %Gplatform microcode: firmware: requesting amd-ucode/microcode_amd.bin microcode: CPU0: AMD CPU family 0x6 not supported Microcode Update Driver: v2.00 , Peter Oruba [ OK ] Setting hostname eagle-44vm1.eagle.hpdd.intel.com: [ OK ] Setting up Logical Volume Management: No volume groups found [ OK ] Checking filesystems Checking all file systems. [/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/vda1 /dev/vda1: clean, 42885/1310720 files, 545107/5242880 blocks [ OK ] Remounting root filesystem in read-write mode: EXT3-fs (vda1): using internal journal [ OK ] Mounting local filesystems: [ OK ] Enabling local filesystem quotas: [ OK ] Enabling /etc/fstab swaps: Adding 4128764k swap on /dev/vda2. Priority:-1 extents:1 across:4128764k [ OK ] Entering non-interactive startup Calling the system activity data collector (sadc)... Loading kernel ZFS infrastructure: SPL: Loaded module v0.6.3-1 zunicode: module license 'CDDL' taints kernel. Disabling lock debugging due to kernel taint ZFS: Loaded module v0.6.3-1, ZFS pool version 5000, ZFS filesystem version 5 [ OK ] Mounting automounted ZFS filesystems: [ OK ] Exporting ZFS filesystems: [ OK ] Loading OpenIB kernel modules:NET: Registered protocol family 10 lo: Disabled Privacy Extensions [ OK ] Bringing up loopback interface: [ OK ] Bringing up interface eth0: Determining IP information for eth0...eth0: link up, 100Mbps, full-duplex, lpa 0x05E1 connect: Invalid argument done. [ OK ] Starting auditd: [ OK ] Starting system logger: [ OK ] Starting irqbalance: [ OK ] Starting rpcbind: [ OK ] Starting sssd: [ OK ] [ OK ] Starting NFS statd: [ OK ] No kdump initial ramdisk found.[WARNING] Rebuilding /boot/initrd-2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64kdump.img RPC: Registered named UNIX socket transport module. RPC: Registered udp transport module. RPC: Registered tcp transport module. RPC: Registered tcp NFSv4.1 backchannel transport module. Slow work thread pool: Starting up Slow work thread pool: Ready FS-Cache: Loaded NFS: Registering the id_resolver key type FS-Cache: Netfs 'nfs' registered for caching mount.nfs: mounting 10.100.0.2:/export/scratch/dumps failed, reason given by server: No such file or directory /etc/kdump.conf: Bad NFS mount eagle-2.eagle.hpdd.intel.com:/export/scratch/dumps Failed to run mkdumprd Starting system message bus: [ OK ] Starting ibacm daemon:[ OK ] Mounting filesystems: [ OK ] Starting acpi daemon: [ OK ] Starting HAL daemon: [ OK ] Retrigger failed udev events[ OK ] Loading autofs4: [ OK ] Starting automount: [ OK ] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). Starting NFS services: [ OK ] Starting NFS quotas: [ OK ] Starting NFS mountd: [ OK ] Starting NFS daemon: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory NFSD: starting 90-second grace period [ OK ] Starting RPC idmapd: [ OK ] Starting MUNGE: munged[ OK ] Starting sshd: [ OK ] Starting xinetd: [ OK ] Starting ntpd: [ OK ] Starting postfix: [ OK ] Starting crond: [ OK ] Starting atd: [ OK ] Starting certmonger: [ OK ] CentOS release 6.5 (Final) Kernel 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 on an x86_64 eagle-44vm1.eagle.hpdd.intel.com login: SPL: using hostid 0x00000000 LNet: HW CPU cores: 1, npartitions: 1 alg: No test for crc32 (crc32-table) alg: No test for adler32 (adler32-zlib) padlock: VIA PadLock Hash Engine not detected. Lustre: Lustre: Build Version: jenkins-arch=x86_64,build_type=server,distro=el6,ib_stack=inkernel-96-g3602066-PRISTINE-2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 LNet: Added LNI 10.100.4.126@tcp [8/256/0/180] LNet: Accept secure, port 988 Lustre: lustre-OST0000: new disk, initializing Lustre: srv-lustre-OST0000: No data found on store. Initialize space Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/li Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null Lustre: DEBUG MARKER: mkdir -p /mnt/ost2 Lustre: DEBUG MARKER: zpool list -H lustre-ost2 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost2 Lustre: DEBUG MARKER: mkdir -p /mnt/ost2; mount -t lustre lustre-ost2/ost2 /mnt/ost2 Lustre: lustre-OST0001: new disk, initializing Lustre: srv-lustre-OST0001: No data found on store. Initialize space Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/li Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost2/ost2 2>/dev/null Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/li Lustre: DEBUG MARKER: uname -n Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/utils/gss:/usr/li Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: sanity ============----- Sun Oct 26 22:48:47 PDT 2014 Lustre: DEBUG MARKER: -----============= acceptance-small: sanity ============----- Sun Oct 26 22:48:47 PDT 2014 Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost1' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost1' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost2' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost2' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost2/ost2 2>/dev/null Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: 76 42a 42b 42c 42d 45 51d 68b 34h 40 48a 180 184c Lustre: DEBUG MARKER: excepting tests: 76 42a 42b 42c 42d 45 51d 68b 34h 40 48a 180 184c Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 0a: touch\; rm ======================= 22:49:03 \(1414388943\) Lustre: DEBUG MARKER: == sanity test 0a: touch; rm ======================= 22:49:03 (1414388943) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 0b: chmod 0755 \/mnt\/lustre =============================== 22:49:05 \(1414388945\) Lustre: DEBUG MARKER: == sanity test 0b: chmod 0755 /mnt/lustre =============================== 22:49:05 (1414388945) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 0c: check import proc =============================== 22:49:06 \(1414388946\) Lustre: DEBUG MARKER: == sanity test 0c: check import proc =============================== 22:49:06 (1414388946) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 1: mkdir\; remkdir\; rmdir ================================ 22:49:07 \(1414388947\) Lustre: DEBUG MARKER: == sanity test 1: mkdir; remkdir; rmdir ================================ 22:49:07 (1414388947) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 2: mkdir\; touch\; rmdir\; check file ====================== 22:49:09 \(1414388949\) Lustre: DEBUG MARKER: == sanity test 2: mkdir; touch; rmdir; check file ====================== 22:49:09 (1414388949) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 3: mkdir\; touch\; rmdir\; check dir ======================= 22:49:10 \(1414388950\) Lustre: DEBUG MARKER: == sanity test 3: mkdir; touch; rmdir; check dir ======================= 22:49:10 (1414388950) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 4: mkdir\; touch dir\/file\; rmdir\; checkdir \(expect error\) == 22:49:11 \(1414388951\) Lustre: DEBUG MARKER: == sanity test 4: mkdir; touch dir/file; rmdir; checkdir (expect error) == 22:49:11 (1414388951) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 5: mkdir ...\/d5 ...\/d5\/d2\; chmod ...\/d5\/d2 ============== 22:49:12 \(1414388952\) Lustre: DEBUG MARKER: == sanity test 5: mkdir .../d5 .../d5/d2; chmod .../d5/d2 ============== 22:49:12 (1414388952) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 6a: touch f6a\; chmod f6a\; runas -u 500 -g 500 chmod f6a \(should return error\) ==== 22:49:14 \(1414388954\) Lustre: DEBUG MARKER: == sanity test 6a: touch f6a; chmod f6a; runas -u 500 -g 500 chmod f6a (should return error) ==== 22:49:14 (1414388954) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 6c: touch f6c\; chown f6c\; runas -u 500 -g 500 chown f6c \(should return error\) ==== 22:49:16 \(1414388956\) Lustre: DEBUG MARKER: == sanity test 6c: touch f6c; chown f6c; runas -u 500 -g 500 chown f6c (should return error) ==== 22:49:16 (1414388956) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 6e: touch f6e\; chgrp f6e\; runas -u 500 -g 500 chgrp f6e \(should return error\) ==== 22:49:17 \(1414388957\) Lustre: DEBUG MARKER: == sanity test 6e: touch f6e; chgrp f6e; runas -u 500 -g 500 chgrp f6e (should return error) ==== 22:49:17 (1414388957) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 6g: Is new dir in sgid dir inheriting group? == 22:49:18 \(1414388958\) Lustre: DEBUG MARKER: == sanity test 6g: Is new dir in sgid dir inheriting group? == 22:49:18 (1414388958) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 6h: runas -u 500 -g 500 chown RUNAS_ID.0 ...\/f6h \(should return error\) == 22:49:20 \(1414388960\) Lustre: DEBUG MARKER: == sanity test 6h: runas -u 500 -g 500 chown RUNAS_ID.0 .../f6h (should return error) == 22:49:20 (1414388960) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 7a: mkdir ...\/d7\; mcreate ...\/d7\/f\; chmod ...\/d7\/f ====== 22:49:21 \(1414388961\) Lustre: DEBUG MARKER: == sanity test 7a: mkdir .../d7; mcreate .../d7/f; chmod .../d7/f ====== 22:49:21 (1414388961) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 7b: mkdir ...\/d7\; mcreate d7\/f2\; echo foo \> d7\/f2 ======= 22:49:23 \(1414388963\) Lustre: DEBUG MARKER: == sanity test 7b: mkdir .../d7; mcreate d7/f2; echo foo > d7/f2 ======= 22:49:23 (1414388963) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 8: mkdir ...\/d8\; touch ...\/d8\/f\; chmod ...\/d8\/f ========= 22:49:24 \(1414388964\) Lustre: DEBUG MARKER: == sanity test 8: mkdir .../d8; touch .../d8/f; chmod .../d8/f ========= 22:49:24 (1414388964) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 9: mkdir ...\/d9 ...\/d9\/d2 ...\/d9\/d2\/d3 ================== 22:49:25 \(1414388965\) Lustre: DEBUG MARKER: == sanity test 9: mkdir .../d9 .../d9/d2 .../d9/d2/d3 ================== 22:49:25 (1414388965) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 10: mkdir ...\/d10 ...\/d10\/d2\; touch ...\/d10\/d2\/f ======== 22:49:27 \(1414388967\) Lustre: DEBUG MARKER: == sanity test 10: mkdir .../d10 .../d10/d2; touch .../d10/d2/f ======== 22:49:27 (1414388967) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 11: mkdir ...\/d11 d11\/d2\; chmod ...\/d11\/d2 ============== 22:49:28 \(1414388968\) Lustre: DEBUG MARKER: == sanity test 11: mkdir .../d11 d11/d2; chmod .../d11/d2 ============== 22:49:28 (1414388968) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 12: touch ...\/d12\/f\; chmod ...\/d12\/f ...\/d12\/f ========== 22:49:30 \(1414388970\) Lustre: DEBUG MARKER: == sanity test 12: touch .../d12/f; chmod .../d12/f .../d12/f ========== 22:49:30 (1414388970) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 13: creat ...\/d13\/f\; dd ...\/d13\/f\; \> ...\/d13\/f ========== 22:49:31 \(1414388971\) Lustre: DEBUG MARKER: == sanity test 13: creat .../d13/f; dd .../d13/f; > .../d13/f ========== 22:49:31 (1414388971) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 14: touch ...\/d14\/f\; rm ...\/d14\/f\; rm ...\/d14\/f ========= 22:49:33 \(1414388973\) Lustre: DEBUG MARKER: == sanity test 14: touch .../d14/f; rm .../d14/f; rm .../d14/f ========= 22:49:33 (1414388973) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 15: touch ...\/d15\/f\; mv ...\/d15\/f ...\/d15\/f2 ============ 22:49:34 \(1414388974\) Lustre: DEBUG MARKER: == sanity test 15: touch .../d15/f; mv .../d15/f .../d15/f2 ============ 22:49:34 (1414388974) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 16: touch ...\/d16\/f\; rm -rf ...\/d16\/f =================== 22:49:35 \(1414388975\) Lustre: DEBUG MARKER: == sanity test 16: touch .../d16/f; rm -rf .../d16/f =================== 22:49:35 (1414388975) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17a: symlinks: create, remove \(real\) ==================== 22:49:37 \(1414388977\) Lustre: DEBUG MARKER: == sanity test 17a: symlinks: create, remove (real) ==================== 22:49:37 (1414388977) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17b: symlinks: create, remove \(dangling\) ================ 22:49:38 \(1414388978\) Lustre: DEBUG MARKER: == sanity test 17b: symlinks: create, remove (dangling) ================ 22:49:38 (1414388978) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17c: symlinks: open dangling \(should return error\) ====== 22:49:39 \(1414388979\) Lustre: DEBUG MARKER: == sanity test 17c: symlinks: open dangling (should return error) ====== 22:49:39 (1414388979) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17d: symlinks: create dangling ========================== 22:49:41 \(1414388981\) Lustre: DEBUG MARKER: == sanity test 17d: symlinks: create dangling ========================== 22:49:41 (1414388981) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17e: symlinks: create recursive symlink \(should return error\) ====== 22:49:42 \(1414388982\) Lustre: DEBUG MARKER: == sanity test 17e: symlinks: create recursive symlink (should return error) ====== 22:49:42 (1414388982) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17f: symlinks: long and very long symlink name ========================== 22:49:43 \(1414388983\) Lustre: DEBUG MARKER: == sanity test 17f: symlinks: long and very long symlink name ========================== 22:49:43 (1414388983) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17g: symlinks: really long symlink name and inode boundaries == 22:49:44 \(1414388984\) Lustre: DEBUG MARKER: == sanity test 17g: symlinks: really long symlink name and inode boundaries == 22:49:44 (1414388984) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17h: create objects: lov_free_memmd\(\) doesn\'t lbug == 22:49:48 \(1414388988\) Lustre: DEBUG MARKER: == sanity test 17h: create objects: lov_free_memmd() doesn't lbug == 22:49:48 (1414388988) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17i: don\'t panic on short symlink == 22:49:49 \(1414388989\) Lustre: DEBUG MARKER: == sanity test 17i: don't panic on short symlink == 22:49:49 (1414388989) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17k: symlinks: rsync with xattrs enabled =========================== 22:49:51 \(1414388991\) Lustre: DEBUG MARKER: == sanity test 17k: symlinks: rsync with xattrs enabled =========================== 22:49:51 (1414388991) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17l: Ensure lgetxattr\'s returned xattr size is consistent ========== 22:49:52 \(1414388992\) Lustre: DEBUG MARKER: == sanity test 17l: Ensure lgetxattr's returned xattr size is consistent ========== 22:49:52 (1414388992) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17m: run e2fsck against MDT which contains short\/long symlink == 22:49:54 \(1414388994\) Lustre: DEBUG MARKER: == sanity test 17m: run e2fsck against MDT which contains short/long symlink == 22:49:54 (1414388994) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_17m only for ldiskfs MDT Lustre: DEBUG MARKER: SKIP: sanity test_17m only for ldiskfs MDT Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17n: run e2fsck against master\/slave MDT which contains remote dir == 22:49:56 \(1414388996\) Lustre: DEBUG MARKER: == sanity test 17n: run e2fsck against master/slave MDT which contains remote dir == 22:49:56 (1414388996) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_17n only for ldiskfs MDT Lustre: DEBUG MARKER: SKIP: sanity test_17n only for ldiskfs MDT Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 17o: stat file with incompat LMA feature == 22:49:58 \(1414388998\) Lustre: DEBUG MARKER: == sanity test 17o: stat file with incompat LMA feature == 22:49:58 (1414388998) LustreError: 11-0: lustre-MDT0000-lwp-OST0001: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -19. Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete LustreError: 11-0: MGC10.100.4.133@tcp: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.100.4.133@tcp) after server handle changed from 0x1bd47fffbe544f25 to 0x1bd47fffbe5473f3 Lustre: MGC10.100.4.133@tcp: Connection restored to MGS (at 10.100.4.133@tcp) Lustre: lustre-OST0000: deleting orphan objects from 0x0:15 to 0x0:33 Lustre: lustre-OST0001: deleting orphan objects from 0x0:14 to 0x0:33 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 18: touch ...\/f \; ls ... ================================ 22:50:20 \(1414389020\) Lustre: DEBUG MARKER: == sanity test 18: touch .../f ; ls ... ================================ 22:50:20 (1414389020) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414389010/real 1414389010] req@ffff88006e8b4400 x1483094239478512/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414389021 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 19a: touch ...\/f19 \; ls -l ... \; rm ...\/f19 ============= 22:50:21 \(1414389021\) Lustre: DEBUG MARKER: == sanity test 19a: touch .../f19 ; ls -l ... ; rm .../f19 ============= 22:50:21 (1414389021) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 19b: ls -l ...\/f19 \(should return error\) ================ 22:50:23 \(1414389023\) Lustre: DEBUG MARKER: == sanity test 19b: ls -l .../f19 (should return error) ================ 22:50:23 (1414389023) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 19c: runas -u 500 -g 500 touch ...\/f19 \(should return error\) ==== 22:50:24 \(1414389024\) Lustre: DEBUG MARKER: == sanity test 19c: runas -u 500 -g 500 touch .../f19 (should return error) ==== 22:50:24 (1414389024) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true LustreError: 167-0: lustre-MDT0000-lwp-OST0000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to lustre-MDT0000 (at 10.100.4.133@tcp) Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 19d: cat ...\/f19 \(should return error\) ================ 22:50:25 \(1414389025\) Lustre: DEBUG MARKER: == sanity test 19d: cat .../f19 (should return error) ================ 22:50:25 (1414389025) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 20: touch ...\/f \; ls -l ... ============================= 22:50:27 \(1414389027\) Lustre: DEBUG MARKER: == sanity test 20: touch .../f ; ls -l ... ============================= 22:50:27 (1414389027) Lustre: DEBUG MARKER: /usr/sbin/lctl mark 1 done Lustre: DEBUG MARKER: 1 done Lustre: DEBUG MARKER: /usr/sbin/lctl mark 2 done Lustre: DEBUG MARKER: 2 done Lustre: DEBUG MARKER: /usr/sbin/lctl mark 3 done Lustre: DEBUG MARKER: 3 done Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 21: write to dangling link ============================== 22:50:29 \(1414389029\) Lustre: DEBUG MARKER: == sanity test 21: write to dangling link ============================== 22:50:29 (1414389029) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 22: unpack tar archive as non-root user ================= 22:50:31 \(1414389031\) Lustre: DEBUG MARKER: == sanity test 22: unpack tar archive as non-root user ================= 22:50:31 (1414389031) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 23a: O_CREAT\|O_EXCL in subdir ============================ 22:50:33 \(1414389033\) Lustre: DEBUG MARKER: == sanity test 23a: O_CREAT|O_EXCL in subdir ============================ 22:50:33 (1414389033) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 23b: O_APPEND check ============================ 22:50:34 \(1414389034\) Lustre: DEBUG MARKER: == sanity test 23b: O_APPEND check ============================ 22:50:34 (1414389034) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24a: rename file to non-existent target == 22:50:35 \(1414389035\) Lustre: DEBUG MARKER: == sanity test 24a: rename file to non-existent target == 22:50:35 (1414389035) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24b: rename file to existing target == 22:50:36 \(1414389036\) Lustre: DEBUG MARKER: == sanity test 24b: rename file to existing target == 22:50:36 (1414389036) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24c: rename directory to non-existent target == 22:50:38 \(1414389038\) Lustre: DEBUG MARKER: == sanity test 24c: rename directory to non-existent target == 22:50:38 (1414389038) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24d: rename directory to existing target == 22:50:39 \(1414389039\) Lustre: DEBUG MARKER: == sanity test 24d: rename directory to existing target == 22:50:39 (1414389039) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24e: touch ...\/R5a\/f\; rename ...\/R5a\/f ...\/R5b\/g ======== 22:50:40 \(1414389040\) Lustre: DEBUG MARKER: == sanity test 24e: touch .../R5a/f; rename .../R5a/f .../R5b/g ======== 22:50:40 (1414389040) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24f: touch ...\/R6a\/f R6b\/g\; mv ...\/R6a\/f ...\/R6b\/g ====== 22:50:42 \(1414389042\) Lustre: DEBUG MARKER: == sanity test 24f: touch .../R6a/f R6b/g; mv .../R6a/f .../R6b/g ====== 22:50:42 (1414389042) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24g: mkdir ...\/R7{a,b}\/d\; mv ...\/R7a\/d ...\/R7b\/e ======== 22:50:43 \(1414389043\) Lustre: DEBUG MARKER: == sanity test 24g: mkdir .../R7a/d; .../R7b/d; mv .../R7a/d .../R7b/e ======== 22:50:43 (1414389043) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24h: mkdir ...\/R8{a,b}\/{d,e}\; rename ...\/R8a\/d ...\/R8b\/e == 22:50:44 \(1414389044\) Lustre: DEBUG MARKER: == sanity test 24h: mkdir .../R8a/d; .../R8a/e; .../R8b/d; .../R8b/e; rename .../R8a/d .../R8b/e == 22:50:44 (1414389044) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24i: rename file to dir error: touch f \; mkdir a \; rename f a == 22:50:46 \(1414389046\) Lustre: DEBUG MARKER: == sanity test 24i: rename file to dir error: touch f ; mkdir a ; rename f a == 22:50:46 (1414389046) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24j: source does not exist ============================== 22:50:47 \(1414389047\) Lustre: DEBUG MARKER: == sanity test 24j: source does not exist ============================== 22:50:47 (1414389047) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24k: touch ...\/R11a\/f\; mv ...\/R11a\/f ...\/R11a\/d ========= 22:50:48 \(1414389048\) Lustre: DEBUG MARKER: == sanity test 24k: touch .../R11a/f; mv .../R11a/f .../R11a/d ========= 22:50:48 (1414389048) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24l: Renaming a file to itself ========================== 22:50:50 \(1414389050\) Lustre: DEBUG MARKER: == sanity test 24l: Renaming a file to itself ========================== 22:50:50 (1414389050) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24m: Renaming a file to a hard link to itself =========== 22:50:51 \(1414389051\) Lustre: DEBUG MARKER: == sanity test 24m: Renaming a file to a hard link to itself =========== 22:50:51 (1414389051) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24n: Statting the old file after renaming \(Posix rename 2\) == 22:50:52 \(1414389052\) Lustre: DEBUG MARKER: == sanity test 24n: Statting the old file after renaming (Posix rename 2) == 22:50:52 (1414389052) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24o: rename of files during htree split ================= 22:50:54 \(1414389054\) Lustre: DEBUG MARKER: == sanity test 24o: rename of files during htree split ================= 22:50:54 (1414389054) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24p: mkdir ...\/R12{a,b}\; rename ...\/R12a ...\/R12b == 22:54:06 \(1414389246\) Lustre: DEBUG MARKER: == sanity test 24p: mkdir .../R12a; .../R12b; rename .../R12a .../R12b == 22:54:06 (1414389246) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24q: mkdir ...\/R13{a,b}\; open R13b rename R13a R13b ===== 22:54:08 \(1414389248\) Lustre: DEBUG MARKER: == sanity test 24q: mkdir .../R13a; .../R13b; open R13b rename R13a R13b ===== 22:54:08 (1414389248) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24r: mkdir ...\/R14a\/b\; rename ...\/R14a ...\/R14a\/b ======= 22:54:09 \(1414389249\) Lustre: DEBUG MARKER: == sanity test 24r: mkdir .../R14a/b; rename .../R14a .../R14a/b ======= 22:54:09 (1414389249) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24s: mkdir ...\/R15a\/b\/c\; rename ...\/R15a ...\/R15a\/b\/c === 22:54:10 \(1414389250\) Lustre: DEBUG MARKER: == sanity test 24s: mkdir .../R15a/b/c; rename .../R15a .../R15a/b/c === 22:54:10 (1414389250) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24t: mkdir ...\/R16a\/b\/c\; rename ...\/R16a\/b\/c ...\/R16a === 22:54:12 \(1414389252\) Lustre: DEBUG MARKER: == sanity test 24t: mkdir .../R16a/b/c; rename .../R16a/b/c .../R16a === 22:54:12 (1414389252) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24u: create stripe file == 22:54:13 \(1414389253\) Lustre: DEBUG MARKER: == sanity test 24u: create stripe file == 22:54:13 (1414389253) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24v: list directory with large files \(handle hash collision, bug: 17560\) == 22:54:14 \(1414389254\) Lustre: DEBUG MARKER: == sanity test 24v: list directory with large files (handle hash collision, bug: 17560) == 22:54:14 (1414389254) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24w: Reading a file larger than 4Gb == 22:55:43 \(1414389343\) Lustre: DEBUG MARKER: == sanity test 24w: Reading a file larger than 4Gb == 22:55:43 (1414389343) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24x: cross rename\/link should be failed == 22:55:44 \(1414389344\) Lustre: DEBUG MARKER: == sanity test 24x: cross rename/link should be failed == 22:55:44 (1414389344) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_24x needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_24x needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24y: rename\/link on the same dir should succeed == 22:55:46 \(1414389346\) Lustre: DEBUG MARKER: == sanity test 24y: rename/link on the same dir should succeed == 22:55:46 (1414389346) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_24y needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_24y needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24z: rename one remote dir to another remote dir should fail == 22:55:48 \(1414389348\) Lustre: DEBUG MARKER: == sanity test 24z: rename one remote dir to another remote dir should fail == 22:55:48 (1414389348) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_24z needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_24z needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 24A: readdir\(\) returns correct number of entries. == 22:55:49 \(1414389349\) Lustre: DEBUG MARKER: == sanity test 24A: readdir() returns correct number of entries. == 22:55:49 (1414389349) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 25a: create file in symlinked directory ================= 22:56:32 \(1414389392\) Lustre: DEBUG MARKER: == sanity test 25a: create file in symlinked directory ================= 22:56:32 (1414389392) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 25b: lookup file in symlinked directory ================= 22:56:33 \(1414389393\) Lustre: DEBUG MARKER: == sanity test 25b: lookup file in symlinked directory ================= 22:56:33 (1414389393) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 26a: multiple component symlink ========================= 22:56:34 \(1414389394\) Lustre: DEBUG MARKER: == sanity test 26a: multiple component symlink ========================= 22:56:34 (1414389394) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 26b: multiple component symlink at end of lookup ======== 22:56:36 \(1414389396\) Lustre: DEBUG MARKER: == sanity test 26b: multiple component symlink at end of lookup ======== 22:56:36 (1414389396) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 26c: chain of symlinks ================================== 22:56:37 \(1414389397\) Lustre: DEBUG MARKER: == sanity test 26c: chain of symlinks ================================== 22:56:37 (1414389397) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 26d: create multiple component recursive symlink ======== 22:56:38 \(1414389398\) Lustre: DEBUG MARKER: == sanity test 26d: create multiple component recursive symlink ======== 22:56:38 (1414389398) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 26e: unlink multiple component recursive symlink ======== 22:56:39 \(1414389399\) Lustre: DEBUG MARKER: == sanity test 26e: unlink multiple component recursive symlink ======== 22:56:39 (1414389399) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 26f: rm -r of a directory which has recursive symlink === 22:56:41 \(1414389401\) Lustre: DEBUG MARKER: == sanity test 26f: rm -r of a directory which has recursive symlink === 22:56:41 (1414389401) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27a: one stripe file ==================================== 22:56:42 \(1414389402\) Lustre: DEBUG MARKER: == sanity test 27a: one stripe file ==================================== 22:56:42 (1414389402) Lustre: DEBUG MARKER: /usr/sbin/lctl mark == test_27a: write to one stripe file ========================= Lustre: DEBUG MARKER: == test_27a: write to one stripe file ========================= Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27b: create and write to two stripe file == 22:56:44 \(1414389404\) Lustre: DEBUG MARKER: == sanity test 27b: create and write to two stripe file == 22:56:44 (1414389404) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27d: create file with default settings ================== 22:56:45 \(1414389405\) Lustre: DEBUG MARKER: == sanity test 27d: create file with default settings ================== 22:56:45 (1414389405) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27e: setstripe existing file \(should return error\) ======== 22:56:47 \(1414389407\) Lustre: DEBUG MARKER: == sanity test 27e: setstripe existing file (should return error) ======== 22:56:47 (1414389407) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27f: setstripe with bad stripe size \(should return error\) == 22:56:48 \(1414389408\) Lustre: DEBUG MARKER: == sanity test 27f: setstripe with bad stripe size (should return error) == 22:56:48 (1414389408) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27g: \/usr\/bin\/lfs getstripe with no objects == 22:56:49 \(1414389409\) Lustre: DEBUG MARKER: == sanity test 27g: /usr/bin/lfs getstripe with no objects == 22:56:49 (1414389409) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27i: \/usr\/bin\/lfs getstripe with some objects == 22:56:51 \(1414389411\) Lustre: DEBUG MARKER: == sanity test 27i: /usr/bin/lfs getstripe with some objects == 22:56:51 (1414389411) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27j: setstripe with bad stripe offset \(should return error\) == 22:56:52 \(1414389412\) Lustre: DEBUG MARKER: == sanity test 27j: setstripe with bad stripe offset (should return error) == 22:56:52 (1414389412) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27k: limit i_blksize for broken user apps =============== 22:56:53 \(1414389413\) Lustre: DEBUG MARKER: == sanity test 27k: limit i_blksize for broken user apps =============== 22:56:53 (1414389413) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27l: check setstripe permissions \(should return error\) == 22:56:54 \(1414389414\) Lustre: DEBUG MARKER: == sanity test 27l: check setstripe permissions (should return error) == 22:56:54 (1414389414) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27m: create file while OST0 was full ==================== 22:56:56 \(1414389416\) Lustre: DEBUG MARKER: == sanity test 27m: create file while OST0 was full ==================== 22:56:56 (1414389416) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_27m 130548096 \> 400000 skipping out-of-space test on OST0 Lustre: DEBUG MARKER: SKIP: sanity test_27m 130548096 > 400000 skipping out-of-space test on OST0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27n: create file with some full OSTs ==================== 22:56:57 \(1414389417\) Lustre: DEBUG MARKER: == sanity test 27n: create file with some full OSTs ==================== 22:56:57 (1414389417) Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_val=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x80000215 Lustre: *** cfs_fail_loc=215, val=0*** Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27o: create file with all full OSTs \(should error\) ====== 22:57:36 \(1414389456\) Lustre: DEBUG MARKER: == sanity test 27o: create file with all full OSTs (should error) ====== 22:57:36 (1414389456) Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: *** cfs_fail_loc=215, val=0*** Lustre: *** cfs_fail_loc=215, val=1*** Lustre: Skipped 1 previous similar message Lustre: *** cfs_fail_loc=215, val=0*** Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: *** cfs_fail_loc=215, val=0*** Lustre: Skipped 5 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27p: append to a truncated file with some full OSTs ===== 22:58:31 \(1414389511\) Lustre: DEBUG MARKER: == sanity test 27p: append to a truncated file with some full OSTs ===== 22:58:31 (1414389511) Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_val=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x80000215 Lustre: *** cfs_fail_loc=215, val=0*** Lustre: Skipped 3 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27q: append to truncated file with all OSTs full \(should error\) ===== 22:59:10 \(1414389550\) Lustre: DEBUG MARKER: == sanity test 27q: append to truncated file with all OSTs full (should error) ===== 22:59:10 (1414389550) Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: *** cfs_fail_loc=215, val=1*** Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27r: stripe file with some full OSTs \(shouldn\'t LBUG\) === 23:00:04 \(1414389604\) Lustre: DEBUG MARKER: == sanity test 27r: stripe file with some full OSTs (shouldn't LBUG) === 23:00:04 (1414389604) Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_val=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x80000215 Lustre: *** cfs_fail_loc=215, val=0*** Lustre: Skipped 15 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27s: lsm_xfersize overflow \(should error\) \(bug 10725\) == 23:00:42 \(1414389642\) Lustre: DEBUG MARKER: == sanity test 27s: lsm_xfersize overflow (should error) (bug 10725) == 23:00:42 (1414389642) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27t: check that utils parse path correctly == 23:00:44 \(1414389644\) Lustre: DEBUG MARKER: == sanity test 27t: check that utils parse path correctly == 23:00:44 (1414389644) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27u: skip object creation on OSC w\/o objects ============ 23:00:45 \(1414389645\) Lustre: DEBUG MARKER: == sanity test 27u: skip object creation on OSC w/o objects ============ 23:00:45 (1414389645) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27v: skip object creation on slow OST =================== 23:01:10 \(1414389670\) Lustre: DEBUG MARKER: == sanity test 27v: skip object creation on slow OST =================== 23:01:10 (1414389670) Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: *** cfs_fail_loc=215, val=0*** Lustre: Skipped 4 previous similar messages Lustre: *** cfs_fail_loc=215, val=0*** Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x215 Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x705 Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27w: check \/usr\/bin\/lfs setstripe -S option == 23:02:15 \(1414389735\) Lustre: DEBUG MARKER: == sanity test 27w: check /usr/bin/lfs setstripe -S option == 23:02:15 (1414389735) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27wa: check \/usr\/bin\/lfs setstripe -c -i options == 23:02:16 \(1414389736\) Lustre: DEBUG MARKER: == sanity test 27wa: check /usr/bin/lfs setstripe -c -i options == 23:02:16 (1414389736) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27x: create files while OST0 is degraded == 23:02:18 \(1414389738\) Lustre: DEBUG MARKER: == sanity test 27x: create files while OST0 is degraded == 23:02:18 (1414389738) Lustre: DEBUG MARKER: lctl set_param -n obdfilter.lustre-OST0000.degraded 1 Lustre: DEBUG MARKER: lctl set_param -n obdfilter.lustre-OST0000.degraded 0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27y: create files while OST0 is degraded and the rest inactive == 23:02:30 \(1414389750\) Lustre: DEBUG MARKER: == sanity test 27y: create files while OST0 is degraded and the rest inactive == 23:02:30 (1414389750) Lustre: DEBUG MARKER: lctl set_param -n obdfilter.lustre-OST0000.degraded=1 Lustre: DEBUG MARKER: lctl set_param -n obdfilter.lustre-OST0000.degraded=0 Lustre: lustre-OST0001: Client lustre-MDT0000-mdtlov_UUID (at 10.100.4.133@tcp) reconnecting Lustre: lustre-OST0001: deleting orphan objects from 0x0:1174 to 0x0:1217 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27z: check SEQ\/OID on the MDT and OST filesystems == 23:02:54 \(1414389774\) Lustre: DEBUG MARKER: == sanity test 27z: check SEQ/OID on the MDT and OST filesystems == 23:02:54 (1414389774) Lustre: DEBUG MARKER: /usr/sbin/lctl mark check file \/mnt\/lustre\/d27z.sanity\/f27z.sanity-1 Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark FID seq 0x200000400, oid 0x67fd ver 0x0 Lustre: DEBUG MARKER: FID seq 0x200000400, oid 0x67fd ver 0x0 Lustre: DEBUG MARKER: /usr/sbin/lctl mark LOV seq 0x200000400, oid 0x67fd, count: 1 Lustre: DEBUG MARKER: LOV seq 0x200000400, oid 0x67fd, count: 1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark check file \/mnt\/lustre\/d27z.sanity\/f27z.sanity-2 Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-2 Lustre: DEBUG MARKER: /usr/sbin/lctl mark FID seq 0x200000400, oid 0x67ff ver 0x0 Lustre: DEBUG MARKER: FID seq 0x200000400, oid 0x67ff ver 0x0 Lustre: DEBUG MARKER: /usr/sbin/lctl mark LOV seq 0x200000400, oid 0x67ff, count: 2 Lustre: DEBUG MARKER: LOV seq 0x200000400, oid 0x67ff, count: 2 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27A: check filesystem-wide default LOV EA values == 23:03:04 \(1414389784\) Lustre: DEBUG MARKER: == sanity test 27A: check filesystem-wide default LOV EA values == 23:03:04 (1414389784) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27B: call setstripe on open unlinked file\/rename victim == 23:03:06 \(1414389786\) Lustre: DEBUG MARKER: == sanity test 27B: call setstripe on open unlinked file/rename victim == 23:03:06 (1414389786) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 27C: check full striping across all OSTs == 23:03:07 \(1414389787\) Lustre: DEBUG MARKER: == sanity test 27C: check full striping across all OSTs == 23:03:07 (1414389787) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 28: create\/mknod\/mkdir with bad file types ============== 23:03:08 \(1414389788\) Lustre: DEBUG MARKER: == sanity test 28: create/mknod/mkdir with bad file types ============== 23:03:08 (1414389788) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 29: IT_GETATTR regression ============================== 23:03:10 \(1414389790\) Lustre: DEBUG MARKER: == sanity test 29: IT_GETATTR regression ============================== 23:03:10 (1414389790) Lustre: DEBUG MARKER: /usr/sbin/lctl mark first d29 Lustre: DEBUG MARKER: first d29 Lustre: DEBUG MARKER: /usr/sbin/lctl mark second d29 Lustre: DEBUG MARKER: second d29 Lustre: DEBUG MARKER: /usr/sbin/lctl mark done Lustre: DEBUG MARKER: done Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 30a: execute binary from Lustre \(execve\) ================ 23:03:13 \(1414389793\) Lustre: DEBUG MARKER: == sanity test 30a: execute binary from Lustre (execve) ================ 23:03:13 (1414389793) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 30b: execute binary from Lustre as non-root ============= 23:03:14 \(1414389794\) Lustre: DEBUG MARKER: == sanity test 30b: execute binary from Lustre as non-root ============= 23:03:14 (1414389794) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 30c: execute binary from Lustre without read perms ====== 23:03:16 \(1414389796\) Lustre: DEBUG MARKER: == sanity test 30c: execute binary from Lustre without read perms ====== 23:03:16 (1414389796) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31a: open-unlink file ==================================== 23:03:19 \(1414389799\) Lustre: DEBUG MARKER: == sanity test 31a: open-unlink file ==================================== 23:03:19 (1414389799) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31b: unlink file with multiple links while open ========= 23:03:21 \(1414389801\) Lustre: DEBUG MARKER: == sanity test 31b: unlink file with multiple links while open ========= 23:03:21 (1414389801) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31c: open-unlink file with multiple links =============== 23:03:22 \(1414389802\) Lustre: DEBUG MARKER: == sanity test 31c: open-unlink file with multiple links =============== 23:03:22 (1414389802) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31d: remove of open directory =========================== 23:03:23 \(1414389803\) Lustre: DEBUG MARKER: == sanity test 31d: remove of open directory =========================== 23:03:23 (1414389803) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31e: remove of open non-empty directory ================= 23:03:24 \(1414389804\) Lustre: DEBUG MARKER: == sanity test 31e: remove of open non-empty directory ================= 23:03:24 (1414389804) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31f: remove of open directory with open-unlink file ===== 23:03:26 \(1414389806\) Lustre: DEBUG MARKER: == sanity test 31f: remove of open directory with open-unlink file ===== 23:03:26 (1414389806) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31g: cross directory link================= 23:03:33 \(1414389813\) Lustre: DEBUG MARKER: == sanity test 31g: cross directory link================= 23:03:33 (1414389813) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31h: cross directory link under child================= 23:03:35 \(1414389815\) Lustre: DEBUG MARKER: == sanity test 31h: cross directory link under child================= 23:03:35 (1414389815) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31i: cross directory link under parent================= 23:03:36 \(1414389816\) Lustre: DEBUG MARKER: == sanity test 31i: cross directory link under parent================= 23:03:36 (1414389816) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31j: link for directory================= 23:03:37 \(1414389817\) Lustre: DEBUG MARKER: == sanity test 31j: link for directory================= 23:03:37 (1414389817) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31k: link to file: the same, non-existing, dir================= 23:03:39 \(1414389819\) Lustre: DEBUG MARKER: == sanity test 31k: link to file: the same, non-existing, dir================= 23:03:39 (1414389819) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31m: link to file: the same, non-existing, dir================= 23:03:40 \(1414389820\) Lustre: DEBUG MARKER: == sanity test 31m: link to file: the same, non-existing, dir================= 23:03:40 (1414389820) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31n: check link count of unlinked file == 23:03:42 \(1414389822\) Lustre: DEBUG MARKER: == sanity test 31n: check link count of unlinked file == 23:03:42 (1414389822) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 31o: duplicate hard links with same filename == 23:03:43 \(1414389823\) Lustre: DEBUG MARKER: == sanity test 31o: duplicate hard links with same filename == 23:03:43 (1414389823) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32a: stat d32a\/ext2-mountpoint\/.. ======================= 23:04:03 \(1414389843\) Lustre: DEBUG MARKER: == sanity test 32a: stat d32a/ext2-mountpoint/.. ======================= 23:04:03 (1414389843) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32b: open d32b\/ext2-mountpoint\/.. ======================= 23:04:04 \(1414389844\) Lustre: DEBUG MARKER: == sanity test 32b: open d32b/ext2-mountpoint/.. ======================= 23:04:04 (1414389844) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32c: stat d32c\/ext2-mountpoint\/..\/d2\/test_dir =========== 23:04:05 \(1414389845\) Lustre: DEBUG MARKER: == sanity test 32c: stat d32c/ext2-mountpoint/../d2/test_dir =========== 23:04:05 (1414389845) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32d: open d32d\/ext2-mountpoint\/..\/d2\/test_dir =========== 23:04:07 \(1414389847\) Lustre: DEBUG MARKER: == sanity test 32d: open d32d/ext2-mountpoint/../d2/test_dir =========== 23:04:07 (1414389847) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32e: stat d32e\/symlink-\>tmp\/symlink-\>lustre-subdir ====== 23:04:08 \(1414389848\) Lustre: DEBUG MARKER: == sanity test 32e: stat d32e/symlink->tmp/symlink->lustre-subdir ====== 23:04:08 (1414389848) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32f: open d32f\/symlink-\>tmp\/symlink-\>lustre-subdir ====== 23:04:10 \(1414389850\) Lustre: DEBUG MARKER: == sanity test 32f: open d32f/symlink->tmp/symlink->lustre-subdir ====== 23:04:10 (1414389850) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32g: stat d32g\/symlink-\>tmp\/symlink-\>lustre-subdir\/2 == 23:04:11 \(1414389851\) Lustre: DEBUG MARKER: == sanity test 32g: stat d32g/symlink->tmp/symlink->lustre-subdir/2 == 23:04:11 (1414389851) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32h: open d32h\/symlink-\>tmp\/symlink-\>lustre-subdir\/2 == 23:04:12 \(1414389852\) Lustre: DEBUG MARKER: == sanity test 32h: open d32h/symlink->tmp/symlink->lustre-subdir/2 == 23:04:12 (1414389852) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32i: stat d32i\/ext2-mountpoint\/..\/test_file ============= 23:04:14 \(1414389854\) Lustre: DEBUG MARKER: == sanity test 32i: stat d32i/ext2-mountpoint/../test_file ============= 23:04:14 (1414389854) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32j: open d32j\/ext2-mountpoint\/..\/test_file ============= 23:04:15 \(1414389855\) Lustre: DEBUG MARKER: == sanity test 32j: open d32j/ext2-mountpoint/../test_file ============= 23:04:15 (1414389855) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32k: stat d32k\/ext2-mountpoint\/..\/d2\/test_file ========== 23:04:17 \(1414389857\) Lustre: DEBUG MARKER: == sanity test 32k: stat d32k/ext2-mountpoint/../d2/test_file ========== 23:04:17 (1414389857) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32l: open d32l\/ext2-mountpoint\/..\/d2\/test_file ========== 23:04:18 \(1414389858\) Lustre: DEBUG MARKER: == sanity test 32l: open d32l/ext2-mountpoint/../d2/test_file ========== 23:04:18 (1414389858) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32m: stat d32m\/symlink-\>tmp\/symlink-\>lustre-root ======== 23:04:19 \(1414389859\) Lustre: DEBUG MARKER: == sanity test 32m: stat d32m/symlink->tmp/symlink->lustre-root ======== 23:04:19 (1414389859) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32n: open d32n\/symlink-\>tmp\/symlink-\>lustre-root ======== 23:04:21 \(1414389861\) Lustre: DEBUG MARKER: == sanity test 32n: open d32n/symlink->tmp/symlink->lustre-root ======== 23:04:21 (1414389861) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32o: stat d32o\/symlink-\>tmp\/symlink-\>lustre-root\/ == 23:04:22 \(1414389862\) Lustre: DEBUG MARKER: == sanity test 32o: stat d32o/symlink->tmp/symlink->lustre-root/ == 23:04:22 (1414389862) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32p: open d32p\/symlink-\>tmp\/symlink-\>lustre-root\/ == 23:04:23 \(1414389863\) Lustre: DEBUG MARKER: == sanity test 32p: open d32p/symlink->tmp/symlink->lustre-root/ == 23:04:23 (1414389863) Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_1 Lustre: DEBUG MARKER: 32p_1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_2 Lustre: DEBUG MARKER: 32p_2 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_3 Lustre: DEBUG MARKER: 32p_3 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_4 Lustre: DEBUG MARKER: 32p_4 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_5 Lustre: DEBUG MARKER: 32p_5 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_6 Lustre: DEBUG MARKER: 32p_6 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_7 Lustre: DEBUG MARKER: 32p_7 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_8 Lustre: DEBUG MARKER: 32p_8 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_9 Lustre: DEBUG MARKER: 32p_9 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 32p_10 Lustre: DEBUG MARKER: 32p_10 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32q: stat follows mountpoints in Lustre \(should return error\) == 23:04:29 \(1414389869\) Lustre: DEBUG MARKER: == sanity test 32q: stat follows mountpoints in Lustre (should return error) == 23:04:29 (1414389869) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 32r: opendir follows mountpoints in Lustre \(should return error\) == 23:04:30 \(1414389870\) Lustre: DEBUG MARKER: == sanity test 32r: opendir follows mountpoints in Lustre (should return error) == 23:04:30 (1414389870) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 33aa: write file with mode 444 \(should return error\) ====== 23:04:32 \(1414389872\) Lustre: DEBUG MARKER: == sanity test 33aa: write file with mode 444 (should return error) ====== 23:04:32 (1414389872) Lustre: DEBUG MARKER: /usr/sbin/lctl mark 33_1 Lustre: DEBUG MARKER: 33_1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark 33_2 Lustre: DEBUG MARKER: 33_2 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 33a: test open file\(mode=0444\) with O_RDWR \(should return error\) == 23:04:34 \(1414389874\) Lustre: DEBUG MARKER: == sanity test 33a: test open file(mode=0444) with O_RDWR (should return error) == 23:04:34 (1414389874) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 33b: test open file with malformed flags \(No panic and return error\) == 23:04:36 \(1414389876\) Lustre: DEBUG MARKER: == sanity test 33b: test open file with malformed flags (No panic and return error) == 23:04:36 (1414389876) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 33c: test llobdstat and write_bytes == 23:04:38 \(1414389878\) Lustre: DEBUG MARKER: == sanity test 33c: test llobdstat and write_bytes == 23:04:38 (1414389878) Lustre: DEBUG MARKER: lctl get_param -n obdfilter/lustre-OST0000/stats Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 33d: openfile with 444 modes and malformed flags under remote dir == 23:04:40 \(1414389880\) Lustre: DEBUG MARKER: == sanity test 33d: openfile with 444 modes and malformed flags under remote dir == 23:04:40 (1414389880) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_33d needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_33d needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34a: truncate file that has not been opened ============= 23:04:42 \(1414389882\) Lustre: DEBUG MARKER: == sanity test 34a: truncate file that has not been opened ============= 23:04:42 (1414389882) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34b: O_RDONLY opening file doesn\'t create objects ======= 23:04:43 \(1414389883\) Lustre: DEBUG MARKER: == sanity test 34b: O_RDONLY opening file doesn't create objects ======= 23:04:43 (1414389883) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34c: O_RDWR opening file-with-size works ================ 23:04:44 \(1414389884\) Lustre: DEBUG MARKER: == sanity test 34c: O_RDWR opening file-with-size works ================ 23:04:44 (1414389884) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34d: write to sparse file =============================== 23:04:46 \(1414389886\) Lustre: DEBUG MARKER: == sanity test 34d: write to sparse file =============================== 23:04:46 (1414389886) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34e: create objects, some with size and some without ==== 23:04:47 \(1414389887\) Lustre: DEBUG MARKER: == sanity test 34e: create objects, some with size and some without ==== 23:04:47 (1414389887) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34f: read from a file with no objects until EOF ========= 23:04:48 \(1414389888\) Lustre: DEBUG MARKER: == sanity test 34f: read from a file with no objects until EOF ========= 23:04:48 (1414389888) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 34g: truncate long file ================================= 23:04:50 \(1414389890\) Lustre: DEBUG MARKER: == sanity test 34g: truncate long file ================================= 23:04:50 (1414389890) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_34h skipping ALWAYS excluded test 34h Lustre: DEBUG MARKER: SKIP: sanity test_34h skipping ALWAYS excluded test 34h Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 35a: exec file with mode 444 \(should return and not leak\) ======= 23:04:54 \(1414389894\) Lustre: DEBUG MARKER: == sanity test 35a: exec file with mode 444 (should return and not leak) ======= 23:04:54 (1414389894) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36a: MDS utime check \(mknod, utime\) ===================== 23:04:56 \(1414389896\) Lustre: DEBUG MARKER: == sanity test 36a: MDS utime check (mknod, utime) ===================== 23:04:56 (1414389896) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36b: OST utime check \(open, utime\) ====================== 23:04:57 \(1414389897\) Lustre: DEBUG MARKER: == sanity test 36b: OST utime check (open, utime) ====================== 23:04:57 (1414389897) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36c: non-root MDS utime check \(mknod, utime\) ============ 23:04:59 \(1414389899\) Lustre: DEBUG MARKER: == sanity test 36c: non-root MDS utime check (mknod, utime) ============ 23:04:59 (1414389899) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36d: non-root OST utime check \(open, utime\) ============= 23:05:00 \(1414389900\) Lustre: DEBUG MARKER: == sanity test 36d: non-root OST utime check (open, utime) ============= 23:05:00 (1414389900) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36e: utime on non-owned file \(should return error\) ====== 23:05:02 \(1414389902\) Lustre: DEBUG MARKER: == sanity test 36e: utime on non-owned file (should return error) ====== 23:05:02 (1414389902) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36f: utime on file racing with OST BRW write ============ 23:05:03 \(1414389903\) Lustre: DEBUG MARKER: == sanity test 36f: utime on file racing with OST BRW write ============ 23:05:03 (1414389903) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36g: filter mod data cache expiry ======================= 23:05:08 \(1414389908\) Lustre: DEBUG MARKER: == sanity test 36g: filter mod data cache expiry ======================= 23:05:08 (1414389908) Lustre: DEBUG MARKER: lctl get_param -n obdfilter.*.client_cache_seconds 2> /dev/null | head -n 1 Lustre: DEBUG MARKER: awk '/ll_fmd_cache/ {print $2}' /proc/slabinfo Lustre: DEBUG MARKER: awk '/ll_fmd_cache/ {print $2}' /proc/slabinfo Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 36h: utime on file racing with OST BRW write ============ 23:07:12 \(1414390032\) Lustre: DEBUG MARKER: == sanity test 36h: utime on file racing with OST BRW write ============ 23:07:12 (1414390032) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 38: open a regular file with O_DIRECTORY should return -ENOTDIR ===== 23:07:15 \(1414390035\) Lustre: DEBUG MARKER: == sanity test 38: open a regular file with O_DIRECTORY should return -ENOTDIR ===== 23:07:15 (1414390035) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39: mtime changed on create ============================= 23:07:17 \(1414390037\) Lustre: DEBUG MARKER: == sanity test 39: mtime changed on create ============================= 23:07:17 (1414390037) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39b: mtime change on open, link, unlink, rename ======== 23:07:20 \(1414390040\) Lustre: DEBUG MARKER: == sanity test 39b: mtime change on open, link, unlink, rename ======== 23:07:20 (1414390040) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39c: mtime change on rename ============================= 23:07:25 \(1414390045\) Lustre: DEBUG MARKER: == sanity test 39c: mtime change on rename ============================= 23:07:25 (1414390045) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39d: create, utime, stat ================================ 23:07:30 \(1414390050\) Lustre: DEBUG MARKER: == sanity test 39d: create, utime, stat ================================ 23:07:30 (1414390050) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39e: create, stat, utime, stat ========================== 23:07:32 \(1414390052\) Lustre: DEBUG MARKER: == sanity test 39e: create, stat, utime, stat ========================== 23:07:32 (1414390052) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39f: create, stat, sleep, utime, stat =================== 23:07:33 \(1414390053\) Lustre: DEBUG MARKER: == sanity test 39f: create, stat, sleep, utime, stat =================== 23:07:33 (1414390053) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39g: write, chmod, stat ================================= 23:07:36 \(1414390056\) Lustre: DEBUG MARKER: == sanity test 39g: write, chmod, stat ================================= 23:07:36 (1414390056) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39h: write, utime within one second, stat =============== 23:07:41 \(1414390061\) Lustre: DEBUG MARKER: == sanity test 39h: write, utime within one second, stat =============== 23:07:41 (1414390061) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39i: write, rename, stat ================================ 23:07:44 \(1414390064\) Lustre: DEBUG MARKER: == sanity test 39i: write, rename, stat ================================ 23:07:44 (1414390064) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39j: write, rename, close, stat ========================= 23:07:48 \(1414390068\) Lustre: DEBUG MARKER: == sanity test 39j: write, rename, close, stat ========================= 23:07:48 (1414390068) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug_mb=150 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=-1; Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug_mb=2 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug="trace inode super ext2 malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm"; Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39k: write, utime, close, stat ========================== 23:07:55 \(1414390075\) Lustre: DEBUG MARKER: == sanity test 39k: write, utime, close, stat ========================== 23:07:55 (1414390075) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39l: directory atime update ============================= 23:07:59 \(1414390079\) Lustre: DEBUG MARKER: == sanity test 39l: directory atime update ============================= 23:07:59 (1414390079) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39m: test atime and mtime before 1970 == 23:08:08 \(1414390088\) Lustre: DEBUG MARKER: == sanity test 39m: test atime and mtime before 1970 == 23:08:08 (1414390088) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39n: check that O_NOATIME is honored == 23:08:11 \(1414390091\) Lustre: DEBUG MARKER: == sanity test 39n: check that O_NOATIME is honored == 23:08:11 (1414390091) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 39o: directory cached attributes updated after create ========== 23:08:25 \(1414390105\) Lustre: DEBUG MARKER: == sanity test 39o: directory cached attributes updated after create ========== 23:08:25 (1414390105) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_40 skipping ALWAYS excluded test 40 Lustre: DEBUG MARKER: SKIP: sanity test_40 skipping ALWAYS excluded test 40 Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 41: test small file write + fstat ======================= 23:08:26 \(1414390106\) Lustre: DEBUG MARKER: == sanity test 41: test small file write + fstat ======================= 23:08:26 (1414390106) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_42a skipping ALWAYS excluded test 42a Lustre: DEBUG MARKER: SKIP: sanity test_42a skipping ALWAYS excluded test 42a Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_42b skipping ALWAYS excluded test 42b Lustre: DEBUG MARKER: SKIP: sanity test_42b skipping ALWAYS excluded test 42b Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_42c skipping ALWAYS excluded test 42c Lustre: DEBUG MARKER: SKIP: sanity test_42c skipping ALWAYS excluded test 42c Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_42d skipping ALWAYS excluded test 42d Lustre: DEBUG MARKER: SKIP: sanity test_42d skipping ALWAYS excluded test 42d Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 42e: verify sub-RPC writes are not done synchronously == 23:08:31 \(1414390111\) Lustre: DEBUG MARKER: == sanity test 42e: verify sub-RPC writes are not done synchronously == 23:08:31 (1414390111) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 43: execution of file opened for write should return -ETXTBSY == 23:09:53 \(1414390193\) Lustre: DEBUG MARKER: == sanity test 43: execution of file opened for write should return -ETXTBSY == 23:09:53 (1414390193) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 43a: open\(RDWR\) of file being executed should return -ETXTBSY == 23:09:56 \(1414390196\) Lustre: DEBUG MARKER: == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY == 23:09:56 (1414390196) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 43b: truncate of file being executed should return -ETXTBSY == 23:09:58 \(1414390198\) Lustre: DEBUG MARKER: == sanity test 43b: truncate of file being executed should return -ETXTBSY == 23:09:58 (1414390198) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 43c: md5sum of copy into lustre========================== 23:09:59 \(1414390199\) Lustre: DEBUG MARKER: == sanity test 43c: md5sum of copy into lustre========================== 23:09:59 (1414390199) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 44: zero length read from a sparse stripe =============== 23:10:01 \(1414390201\) Lustre: DEBUG MARKER: == sanity test 44: zero length read from a sparse stripe =============== 23:10:01 (1414390201) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 44a: test sparse pwrite ================================= 23:10:02 \(1414390202\) Lustre: DEBUG MARKER: == sanity test 44a: test sparse pwrite ================================= 23:10:02 (1414390202) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_45 skipping ALWAYS excluded test 45 Lustre: DEBUG MARKER: SKIP: sanity test_45 skipping ALWAYS excluded test 45 Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 46: dirtying a previously written page ================== 23:10:05 \(1414390205\) Lustre: DEBUG MARKER: == sanity test 46: dirtying a previously written page ================== 23:10:05 (1414390205) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_48a skipping ALWAYS excluded test 48a Lustre: DEBUG MARKER: SKIP: sanity test_48a skipping ALWAYS excluded test 48a Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 48b: Access removed working dir \(should return errors\)=== 23:10:07 \(1414390207\) Lustre: DEBUG MARKER: == sanity test 48b: Access removed working dir (should return errors)=== 23:10:07 (1414390207) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 48c: Access removed working subdir \(should return errors\) == 23:10:08 \(1414390208\) Lustre: DEBUG MARKER: == sanity test 48c: Access removed working subdir (should return errors) == 23:10:08 (1414390208) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 48d: Access removed parent subdir \(should return errors\) == 23:10:10 \(1414390210\) Lustre: DEBUG MARKER: == sanity test 48d: Access removed parent subdir (should return errors) == 23:10:10 (1414390210) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 48e: Access to recreated parent subdir \(should return errors\) == 23:10:11 \(1414390211\) Lustre: DEBUG MARKER: == sanity test 48e: Access to recreated parent subdir (should return errors) == 23:10:11 (1414390211) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 49: Change max_pages_per_rpc won\'t break osc extent == 23:10:13 \(1414390213\) Lustre: DEBUG MARKER: == sanity test 49: Change max_pages_per_rpc won't break osc extent == 23:10:13 (1414390213) Lustre: DEBUG MARKER: /usr/bin/lfs df Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 50: special situations: \/proc symlinks ================= 23:10:15 \(1414390215\) Lustre: DEBUG MARKER: == sanity test 50: special situations: /proc symlinks ================= 23:10:15 (1414390215) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 51a: special situations: split htree with empty entry ==== 23:10:16 \(1414390216\) Lustre: DEBUG MARKER: == sanity test 51a: special situations: split htree with empty entry ==== 23:10:16 (1414390216) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 51b: exceed 64k subdirectory nlink limit == 23:10:19 \(1414390219\) Lustre: DEBUG MARKER: == sanity test 51b: exceed 64k subdirectory nlink limit == 23:10:19 (1414390219) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 51ba: verify nlink for many subdirectory cleanup == 23:15:39 \(1414390539\) Lustre: DEBUG MARKER: == sanity test 51ba: verify nlink for many subdirectory cleanup == 23:15:39 (1414390539) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_51d skipping ALWAYS excluded test 51d Lustre: DEBUG MARKER: SKIP: sanity test_51d skipping ALWAYS excluded test 51d Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 52a: append-only flag test \(should return errors\) ======= 23:34:02 \(1414391642\) Lustre: DEBUG MARKER: == sanity test 52a: append-only flag test (should return errors) ======= 23:34:02 (1414391642) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 52b: immutable flag test \(should return errors\) ========= 23:34:04 \(1414391644\) Lustre: DEBUG MARKER: == sanity test 52b: immutable flag test (should return errors) ========= 23:34:04 (1414391644) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 53: verify that MDS and OSTs agree on pre-creation ====== 23:34:05 \(1414391645\) Lustre: DEBUG MARKER: == sanity test 53: verify that MDS and OSTs agree on pre-creation ====== 23:34:05 (1414391645) Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n obdfilter.lustre-OST0000.last_id Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n obdfilter.lustre-OST0001.last_id Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 54a: unix domain socket test ============================ 23:34:10 \(1414391650\) Lustre: DEBUG MARKER: == sanity test 54a: unix domain socket test ============================ 23:34:10 (1414391650) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 54b: char device works in lustre ======================== 23:34:11 \(1414391651\) Lustre: DEBUG MARKER: == sanity test 54b: char device works in lustre ======================== 23:34:11 (1414391651) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 54c: block device works in lustre ======================= 23:34:12 \(1414391652\) Lustre: DEBUG MARKER: == sanity test 54c: block device works in lustre ======================= 23:34:12 (1414391652) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 54d: fifo device works in lustre ======================== 23:34:16 \(1414391656\) Lustre: DEBUG MARKER: == sanity test 54d: fifo device works in lustre ======================== 23:34:16 (1414391656) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 54e: console\/tty device works in lustre ======================== 23:34:17 \(1414391657\) Lustre: DEBUG MARKER: == sanity test 54e: console/tty device works in lustre ======================== 23:34:17 (1414391657) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56a: check \/usr\/bin\/lfs getstripe == 23:34:19 \(1414391659\) Lustre: DEBUG MARKER: == sanity test 56a: check /usr/bin/lfs getstripe == 23:34:19 (1414391659) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56g: check lfs find -name =============================== 23:34:21 \(1414391661\) Lustre: DEBUG MARKER: == sanity test 56g: check lfs find -name =============================== 23:34:21 (1414391661) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56h: check lfs find ! -name =============================== 23:34:22 \(1414391662\) Lustre: DEBUG MARKER: == sanity test 56h: check lfs find ! -name =============================== 23:34:22 (1414391662) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56i: check \'lfs find -ost UUID\' skips directories ========= 23:34:24 \(1414391664\) Lustre: DEBUG MARKER: == sanity test 56i: check 'lfs find -ost UUID' skips directories ========= 23:34:24 (1414391664) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56j: check lfs find -type d =============================== 23:34:26 \(1414391666\) Lustre: DEBUG MARKER: == sanity test 56j: check lfs find -type d =============================== 23:34:26 (1414391666) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56k: check lfs find -type f =============================== 23:34:27 \(1414391667\) Lustre: DEBUG MARKER: == sanity test 56k: check lfs find -type f =============================== 23:34:27 (1414391667) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56l: check lfs find -type b =============================== 23:34:29 \(1414391669\) Lustre: DEBUG MARKER: == sanity test 56l: check lfs find -type b =============================== 23:34:29 (1414391669) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56m: check lfs find -type c =============================== 23:34:31 \(1414391671\) Lustre: DEBUG MARKER: == sanity test 56m: check lfs find -type c =============================== 23:34:31 (1414391671) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56n: check lfs find -type l =============================== 23:34:33 \(1414391673\) Lustre: DEBUG MARKER: == sanity test 56n: check lfs find -type l =============================== 23:34:33 (1414391673) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56o: check lfs find -mtime for old files ============================ 23:34:35 \(1414391675\) Lustre: DEBUG MARKER: == sanity test 56o: check lfs find -mtime for old files ============================ 23:34:35 (1414391675) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56p: check lfs find -uid and ! -uid ================================= 23:34:37 \(1414391677\) Lustre: DEBUG MARKER: == sanity test 56p: check lfs find -uid and ! -uid ================================= 23:34:37 (1414391677) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56q: check lfs find -gid and ! -gid ================================= 23:34:40 \(1414391680\) Lustre: DEBUG MARKER: == sanity test 56q: check lfs find -gid and ! -gid ================================= 23:34:40 (1414391680) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56r: check lfs find -size works ============================ 23:34:42 \(1414391682\) Lustre: DEBUG MARKER: == sanity test 56r: check lfs find -size works ============================ 23:34:42 (1414391682) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56s: check lfs find -stripe-count works == 23:34:46 \(1414391686\) Lustre: DEBUG MARKER: == sanity test 56s: check lfs find -stripe-count works == 23:34:46 (1414391686) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56t: check lfs find -stripe-size works == 23:34:49 \(1414391689\) Lustre: DEBUG MARKER: == sanity test 56t: check lfs find -stripe-size works == 23:34:49 (1414391689) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56u: check lfs find -stripe-index works == 23:34:53 \(1414391693\) Lustre: DEBUG MARKER: == sanity test 56u: check lfs find -stripe-index works == 23:34:53 (1414391693) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56v: check \'lfs find -mdt match with lfs getstripe -M\' ========= 23:34:57 \(1414391697\) Lustre: DEBUG MARKER: == sanity test 56v: check 'lfs find -mdt match with lfs getstripe -M' ========= 23:34:57 (1414391697) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56w: check lfs_migrate -c stripe_count works == 23:34:59 \(1414391699\) Lustre: DEBUG MARKER: == sanity test 56w: check lfs_migrate -c stripe_count works == 23:34:59 (1414391699) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56x: lfs migration support == 23:35:49 \(1414391749\) Lustre: DEBUG MARKER: == sanity test 56x: lfs migration support == 23:35:49 (1414391749) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56y: lfs find -L raid0\|released == 23:35:56 \(1414391756\) Lustre: DEBUG MARKER: == sanity test 56y: lfs find -L raid0|released == 23:35:56 (1414391756) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 56z: lfs find should continue after an error == 23:35:58 \(1414391758\) Lustre: DEBUG MARKER: == sanity test 56z: lfs find should continue after an error == 23:35:58 (1414391758) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 57a: verify MDS filesystem created with large inodes ==== 23:36:01 \(1414391761\) Lustre: DEBUG MARKER: == sanity test 57a: verify MDS filesystem created with large inodes ==== 23:36:01 (1414391761) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_57a Only applicable to ldiskfs-based MDTs Lustre: DEBUG MARKER: SKIP: sanity test_57a Only applicable to ldiskfs-based MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 57b: default LOV EAs are stored inside large inodes ===== 23:36:03 \(1414391763\) Lustre: DEBUG MARKER: == sanity test 57b: default LOV EAs are stored inside large inodes ===== 23:36:03 (1414391763) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_57b Only applicable to ldiskfs-based MDTs Lustre: DEBUG MARKER: SKIP: sanity test_57b Only applicable to ldiskfs-based MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 58: verify cross-platform wire constants ================ 23:36:04 \(1414391764\) Lustre: DEBUG MARKER: == sanity test 58: verify cross-platform wire constants ================ 23:36:04 (1414391764) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 59: verify cancellation of llog records async =========== 23:36:06 \(1414391766\) Lustre: DEBUG MARKER: == sanity test 59: verify cancellation of llog records async =========== 23:36:06 (1414391766) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 60a: llog sanity tests run from kernel module ============ 23:36:20 \(1414391780\) Lustre: DEBUG MARKER: == sanity test 60a: llog sanity tests run from kernel module ============ 23:36:20 (1414391780) Lustre: DEBUG MARKER: /usr/sbin/lctl mark test_60 run 20244 - from kernel mode Lustre: DEBUG MARKER: test_60 run 20244 - from kernel mode Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 60b: limit repeated messages from CERROR\/CWARN ========== 23:37:53 \(1414391873\) Lustre: DEBUG MARKER: == sanity test 60b: limit repeated messages from CERROR/CWARN ========== 23:37:53 (1414391873) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 60c: unlink file when mds full == 23:37:54 \(1414391874\) Lustre: DEBUG MARKER: == sanity test 60c: unlink file when mds full == 23:37:54 (1414391874) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 60d: test printk console message masking == 23:39:42 \(1414391982\) Lustre: DEBUG MARKER: == sanity test 60d: test printk console message masking == 23:39:42 (1414391982) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 61: mmap\(\) writes don\'t make sync hang ================== 23:39:43 \(1414391983\) Lustre: DEBUG MARKER: == sanity test 61: mmap() writes don't make sync hang ================== 23:39:43 (1414391983) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 63a: Verify oig_wait interruption does not crash ========= 23:39:47 \(1414391987\) Lustre: DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ========= 23:39:47 (1414391987) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 63b: async write errors should be returned to fsync ===== 23:40:49 \(1414392049\) Lustre: DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ===== 23:40:49 (1414392049) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug="trace inode super ext2 malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm"; Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 64a: verify filter grant calculations \(in kernel\) ======= 23:40:54 \(1414392054\) Lustre: DEBUG MARKER: == sanity test 64a: verify filter grant calculations (in kernel) ======= 23:40:54 (1414392054) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 64b: check out-of-space detection on client ============= 23:40:55 \(1414392055\) Lustre: DEBUG MARKER: == sanity test 64b: check out-of-space detection on client ============= 23:40:55 (1414392055) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_64b oos.sh: 130504320kB free gt MAXFREE 800000kB, increase 800000 \(or reduce test fs size\) to proceed Lustre: DEBUG MARKER: SKIP: sanity test_64b oos.sh: 130504320kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 64c: verify grant shrink ========================------ == 23:40:58 \(1414392058\) Lustre: DEBUG MARKER: == sanity test 64c: verify grant shrink ========================------ == 23:40:58 (1414392058) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65a: directory with no stripe info ====================== 23:40:59 \(1414392059\) Lustre: DEBUG MARKER: == sanity test 65a: directory with no stripe info ====================== 23:40:59 (1414392059) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65b: directory setstripe -S 2097152 -i 0 -c 1 == 23:41:01 \(1414392061\) Lustre: DEBUG MARKER: == sanity test 65b: directory setstripe -S 2097152 -i 0 -c 1 == 23:41:01 (1414392061) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65c: directory setstripe -S 4194304 -i 1 -c 1 == 23:41:02 \(1414392062\) Lustre: DEBUG MARKER: == sanity test 65c: directory setstripe -S 4194304 -i 1 -c 1 == 23:41:02 (1414392062) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65d: directory setstripe -S 1048576 -c stripe_count == 23:41:03 \(1414392063\) Lustre: DEBUG MARKER: == sanity test 65d: directory setstripe -S 1048576 -c stripe_count == 23:41:03 (1414392063) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65e: directory setstripe defaults ========================= 23:41:05 \(1414392065\) Lustre: DEBUG MARKER: == sanity test 65e: directory setstripe defaults ========================= 23:41:05 (1414392065) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65f: dir setstripe permission \(should return error\) ===== 23:41:06 \(1414392066\) Lustre: DEBUG MARKER: == sanity test 65f: dir setstripe permission (should return error) ===== 23:41:06 (1414392066) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65g: directory setstripe -d ============================= 23:41:08 \(1414392068\) Lustre: DEBUG MARKER: == sanity test 65g: directory setstripe -d ============================= 23:41:08 (1414392068) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65h: directory stripe info inherit ====================== 23:41:09 \(1414392069\) Lustre: DEBUG MARKER: == sanity test 65h: directory stripe info inherit ====================== 23:41:09 (1414392069) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65i: set non-default striping on root directory \(bug 6367\)=== 23:41:10 \(1414392070\) Lustre: DEBUG MARKER: == sanity test 65i: set non-default striping on root directory (bug 6367)=== 23:41:10 (1414392070) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65ia: getstripe on -1 default directory striping == 23:41:12 \(1414392072\) Lustre: DEBUG MARKER: == sanity test 65ia: getstripe on -1 default directory striping == 23:41:12 (1414392072) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65ib: getstripe -v on -1 default directory striping == 23:41:16 \(1414392076\) Lustre: DEBUG MARKER: == sanity test 65ib: getstripe -v on -1 default directory striping == 23:41:16 (1414392076) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65ic: new find on -1 default directory striping == 23:41:19 \(1414392079\) Lustre: DEBUG MARKER: == sanity test 65ic: new find on -1 default directory striping == 23:41:19 (1414392079) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65j: set default striping on root directory \(bug 6367\)=== 23:41:42 \(1414392102\) Lustre: DEBUG MARKER: == sanity test 65j: set default striping on root directory (bug 6367)=== 23:41:42 (1414392102) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65k: validate manual striping works properly with deactivated OSCs == 23:41:45 \(1414392105\) Lustre: DEBUG MARKER: == sanity test 65k: validate manual striping works properly with deactivated OSCs == 23:41:45 (1414392105) Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 10.100.4.133@tcp) reconnecting Lustre: lustre-OST0000: deleting orphan objects from 0x0:3960 to 0x0:4001 Lustre: lustre-OST0001: deleting orphan objects from 0x0:4888 to 0x0:4929 Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 10.100.4.133@tcp) reconnecting Lustre: Skipped 1 previous similar message Lustre: lustre-OST0000: deleting orphan objects from 0x0:3960 to 0x0:4033 Lustre: lustre-OST0001: Client lustre-MDT0000-mdtlov_UUID (at 10.100.4.133@tcp) reconnecting Lustre: lustre-OST0001: deleting orphan objects from 0x0:4932 to 0x0:4961 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 65l: lfs find on -1 stripe dir ========================== 23:41:49 \(1414392109\) Lustre: DEBUG MARKER: == sanity test 65l: lfs find on -1 stripe dir ========================== 23:41:49 (1414392109) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 66: update inode blocks count on client ================= 23:41:51 \(1414392111\) Lustre: DEBUG MARKER: == sanity test 66: update inode blocks count on client ================= 23:41:51 (1414392111) Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync 1 Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync 1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 68a: lloop driver - basic test ========================== 23:42:00 \(1414392120\) Lustre: DEBUG MARKER: == sanity test 68a: lloop driver - basic test ========================== 23:42:00 (1414392120) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_68a llite_lloop module disabled Lustre: DEBUG MARKER: SKIP: sanity test_68a llite_lloop module disabled Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_68b skipping ALWAYS excluded test 68b Lustre: DEBUG MARKER: SKIP: sanity test_68b skipping ALWAYS excluded test 68b Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 69: verify oa2dentry return -ENOENT doesn\'t LBUG ======== 23:42:03 \(1414392123\) Lustre: DEBUG MARKER: == sanity test 69: verify oa2dentry return -ENOENT doesn't LBUG ======== 23:42:03 (1414392123) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x217 Lustre: *** cfs_fail_loc=217, val=0*** Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x217 Lustre: *** cfs_fail_loc=217, val=0*** Lustre: Skipped 7 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 71: Running dbench on lustre \(don\'t segment fault\) ====== 23:42:11 \(1414392131\) Lustre: DEBUG MARKER: == sanity test 71: Running dbench on lustre (don't segment fault) ====== 23:42:11 (1414392131) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 72a: Test that remove suid works properly \(bug5695\) ====== 23:54:18 \(1414392858\) Lustre: DEBUG MARKER: == sanity test 72a: Test that remove suid works properly (bug5695) ====== 23:54:18 (1414392858) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 72b: Test that we keep mode setting if without file data changed \(bug 24226\) == 23:54:22 \(1414392862\) Lustre: DEBUG MARKER: == sanity test 72b: Test that we keep mode setting if without file data changed (bug 24226) == 23:54:22 (1414392862) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 73: multiple MDC requests \(should not deadlock\) == 23:54:26 \(1414392866\) Lustre: DEBUG MARKER: == sanity test 73: multiple MDC requests (should not deadlock) == 23:54:26 (1414392866) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 74a: ldlm_enqueue freed-export error path, ls \(shouldn\'t LBUG\) == 23:54:54 \(1414392894\) Lustre: DEBUG MARKER: == sanity test 74a: ldlm_enqueue freed-export error path, ls (shouldn't LBUG) == 23:54:54 (1414392894) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 74b: ldlm_enqueue freed-export error path, touch \(shouldn\'t LBUG\) == 23:54:55 \(1414392895\) Lustre: DEBUG MARKER: == sanity test 74b: ldlm_enqueue freed-export error path, touch (shouldn't LBUG) == 23:54:55 (1414392895) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 74c: ldlm_lock_create error path, \(shouldn\'t LBUG\) == 23:54:57 \(1414392897\) Lustre: DEBUG MARKER: == sanity test 74c: ldlm_lock_create error path, (shouldn't LBUG) == 23:54:57 (1414392897) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_76 skipping ALWAYS excluded test 76 Lustre: DEBUG MARKER: SKIP: sanity test_76 skipping ALWAYS excluded test 76 Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77a: normal checksum read\/write operation == 23:54:59 \(1414392899\) Lustre: DEBUG MARKER: == sanity test 77a: normal checksum read/write operation == 23:54:59 (1414392899) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77b: checksum error on client write, read == 23:55:02 \(1414392902\) Lustre: DEBUG MARKER: == sanity test 77b: checksum error on client write, read == 23:55:02 (1414392902) LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3f8:0x0] object 0x0:6146 extent [0-1048575]: client csum 2848b43a, server csum 2848b439 Lustre: DEBUG MARKER: /usr/sbin/lctl mark set checksum type to crc32 Lustre: DEBUG MARKER: set checksum type to crc32 Lustre: DEBUG MARKER: /usr/sbin/lctl mark set checksum type to adler Lustre: DEBUG MARKER: set checksum type to adler Lustre: DEBUG MARKER: /usr/sbin/lctl mark set checksum type to adler Lustre: DEBUG MARKER: set checksum type to adler Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77d: checksum error on OST direct write, read == 23:55:13 \(1414392913\) Lustre: DEBUG MARKER: == sanity test 77d: checksum error on OST direct write, read == 23:55:13 (1414392913) LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0000 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3f9:0x0] object 0x0:5223 extent [0-1048575]: client csum 19eeae62, server csum 19eeae61 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77f: repeat checksum error on write \(expect error\) == 23:55:18 \(1414392918\) Lustre: DEBUG MARKER: == sanity test 77f: repeat checksum error on write (expect error) == 23:55:18 (1414392918) Lustre: DEBUG MARKER: /usr/sbin/lctl mark set checksum type to crc32 Lustre: DEBUG MARKER: set checksum type to crc32 LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [0-1048575]: client csum 19eeae62, server csum 19eeae61 LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [2097152-3145727]: client csum 19eeae62, server csum 19eeae61 LustreError: Skipped 8 previous similar messages LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [5242880-6291455]: client csum 19eeae62, server csum 19eeae61 LustreError: Skipped 9 previous similar messages LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [0-1048575]: client csum 19eeae62, server csum 19eeae61 LustreError: Skipped 14 previous similar messages LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [0-1048575]: client csum 19eeae62, server csum 19eeae61 LustreError: Skipped 21 previous similar messages LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [3145728-4194303]: client csum 19eeae62, server csum 19eeae61 LustreError: Skipped 29 previous similar messages Lustre: DEBUG MARKER: /usr/sbin/lctl mark set checksum type to adler Lustre: DEBUG MARKER: set checksum type to adler LustreError: 168-f: BAD WRITE CHECKSUM: lustre-OST0001 from 12345-10.100.4.127@tcp inode [0x200000400:0x1a3fb:0x0] object 0x0:6147 extent [4194304-5242879]: client csum 19eeae62, server csum 19eeae61 LustreError: Skipped 82 previous similar messages Lustre: DEBUG MARKER: /usr/sbin/lctl mark set checksum type to adler Lustre: DEBUG MARKER: set checksum type to adler Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77g: checksum error on OST write, read == 23:57:36 \(1414393056\) Lustre: DEBUG MARKER: == sanity test 77g: checksum error on OST write, read == 23:57:36 (1414393056) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x8000021a Lustre: *** cfs_fail_loc=21a, val=0*** Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x8000021b Lustre: *** cfs_fail_loc=21b, val=0*** Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77i: client not supporting OSD_CONNECT_CKSUM == 23:57:44 \(1414393064\) Lustre: DEBUG MARKER: == sanity test 77i: client not supporting OSD_CONNECT_CKSUM == 23:57:44 (1414393064) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 77j: client only supporting ADLER32 == 23:57:47 \(1414393067\) Lustre: DEBUG MARKER: == sanity test 77j: client only supporting ADLER32 == 23:57:47 (1414393067) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 78: handle large O_DIRECT writes correctly ============== 23:57:51 \(1414393071\) Lustre: DEBUG MARKER: == sanity test 78: handle large O_DIRECT writes correctly ============== 23:57:51 (1414393071) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 79: df report consistency check ========================= 00:08:00 \(1414393680\) Lustre: DEBUG MARKER: == sanity test 79: df report consistency check ========================= 00:08:00 (1414393680) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 80: Page eviction is equally fast at high offsets too ====== 00:08:12 \(1414393692\) Lustre: DEBUG MARKER: == sanity test 80: Page eviction is equally fast at high offsets too ====== 00:08:12 (1414393692) Lustre: DEBUG MARKER: lctl get_param -n obdfilter.*.sync_on_lock_cancel Lustre: DEBUG MARKER: lctl set_param obdfilter.*.sync_on_lock_cancel=never Lustre: DEBUG MARKER: lctl set_param obdfilter.*.sync_on_lock_cancel=always Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 81a: OST should retry write when get -ENOSPC ================= 00:08:15 \(1414393695\) Lustre: DEBUG MARKER: == sanity test 81a: OST should retry write when get -ENOSPC ================= 00:08:15 (1414393695) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x80000228 Lustre: *** cfs_fail_loc=228, val=0*** Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 81b: OST should return -ENOSPC when retry still fails ========= 00:08:19 \(1414393699\) Lustre: DEBUG MARKER: == sanity test 81b: OST should return -ENOSPC when retry still fails ========= 00:08:19 (1414393699) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x228 Lustre: *** cfs_fail_loc=228, val=0*** Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 82: Basic grouplock test ================================= 00:08:22 \(1414393702\) Lustre: DEBUG MARKER: == sanity test 82: Basic grouplock test ================================= 00:08:22 (1414393702) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 99a: cvs init =========================================== 00:08:28 \(1414393708\) Lustre: DEBUG MARKER: == sanity test 99a: cvs init =========================================== 00:08:28 (1414393708) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 99b: cvs import ========================================= 00:08:32 \(1414393712\) Lustre: DEBUG MARKER: == sanity test 99b: cvs import ========================================= 00:08:32 (1414393712) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 99c: cvs checkout ======================================= 00:08:35 \(1414393715\) Lustre: DEBUG MARKER: == sanity test 99c: cvs checkout ======================================= 00:08:35 (1414393715) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 99d: cvs add ============================================ 00:08:43 \(1414393723\) Lustre: DEBUG MARKER: == sanity test 99d: cvs add ============================================ 00:08:43 (1414393723) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 99e: cvs update ========================================= 00:08:45 \(1414393725\) Lustre: DEBUG MARKER: == sanity test 99e: cvs update ========================================= 00:08:45 (1414393725) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 99f: cvs commit ========================================= 00:08:47 \(1414393727\) Lustre: DEBUG MARKER: == sanity test 99f: cvs commit ========================================= 00:08:47 (1414393727) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 100: check local port using privileged port ============= 00:08:52 \(1414393732\) Lustre: DEBUG MARKER: == sanity test 100: check local port using privileged port ============= 00:08:52 (1414393732) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 101a: check read-ahead for random reads ================== 00:08:54 \(1414393734\) Lustre: DEBUG MARKER: == sanity test 101a: check read-ahead for random reads ================== 00:08:54 (1414393734) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 101b: check stride-io mode read-ahead =================== 00:10:12 \(1414393812\) Lustre: DEBUG MARKER: == sanity test 101b: check stride-io mode read-ahead =================== 00:10:12 (1414393812) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=0 osd-*.lustre-OST*.read_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=0 osd-*.lustre-OST*.writethrough_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=1 osd-*.lustre-OST*.read_cache_enable=1 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=1 osd-*.lustre-OST*.writethrough_cache_enable=1 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 101c: check stripe_size aligned read-ahead =================== 00:10:57 \(1414393857\) Lustre: DEBUG MARKER: == sanity test 101c: check stripe_size aligned read-ahead =================== 00:10:57 (1414393857) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=0 osd-*.lustre-OST*.read_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=0 osd-*.lustre-OST*.writethrough_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=1 osd-*.lustre-OST*.read_cache_enable=1 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=1 osd-*.lustre-OST*.writethrough_cache_enable=1 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 101d: file read with and without read-ahead enabled =================== 00:11:33 \(1414393893\) Lustre: DEBUG MARKER: == sanity test 101d: file read with and without read-ahead enabled =================== 00:11:33 (1414393893) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 101e: check read-ahead for small read\(1k\) for small files\(500k\) == 00:19:37 \(1414394377\) Lustre: DEBUG MARKER: == sanity test 101e: check read-ahead for small read(1k) for small files(500k) == 00:19:37 (1414394377) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 101f: check read-ahead for max_read_ahead_whole_mb == 00:20:09 \(1414394409\) Lustre: DEBUG MARKER: == sanity test 101f: check read-ahead for max_read_ahead_whole_mb == 00:20:09 (1414394409) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102a: user xattr test ==================================== 00:20:12 \(1414394412\) Lustre: DEBUG MARKER: == sanity test 102a: user xattr test ==================================== 00:20:12 (1414394412) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102b: getfattr\/setfattr for trusted.lov EAs ============== 00:20:13 \(1414394413\) Lustre: DEBUG MARKER: == sanity test 102b: getfattr/setfattr for trusted.lov EAs ============== 00:20:13 (1414394413) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102c: non-root getfattr\/setfattr for lustre.lov EAs ============= 00:20:15 \(1414394415\) Lustre: DEBUG MARKER: == sanity test 102c: non-root getfattr/setfattr for lustre.lov EAs ============= 00:20:15 (1414394415) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102d: tar restore stripe info from tarfile,not keep osts ============= 00:20:17 \(1414394417\) Lustre: DEBUG MARKER: == sanity test 102d: tar restore stripe info from tarfile,not keep osts ============= 00:20:17 (1414394417) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102f: tar copy files, not keep osts ============= 00:20:22 \(1414394422\) Lustre: DEBUG MARKER: == sanity test 102f: tar copy files, not keep osts ============= 00:20:22 (1414394422) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102h: grow xattr from inside inode to external block == 00:20:28 \(1414394428\) Lustre: DEBUG MARKER: == sanity test 102h: grow xattr from inside inode to external block == 00:20:28 (1414394428) Lustre: DEBUG MARKER: /usr/sbin/lctl mark save trusted.big on \/mnt\/lustre\/f102h.sanity Lustre: DEBUG MARKER: save trusted.big on /mnt/lustre/f102h.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark save trusted.sml on \/mnt\/lustre\/f102h.sanity Lustre: DEBUG MARKER: save trusted.sml on /mnt/lustre/f102h.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark grow trusted.sml on \/mnt\/lustre\/f102h.sanity Lustre: DEBUG MARKER: grow trusted.sml on /mnt/lustre/f102h.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark trusted.big still valid after growing trusted.sml Lustre: DEBUG MARKER: trusted.big still valid after growing trusted.sml Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102ha: grow xattr from inside inode to external inode == 00:20:31 \(1414394431\) Lustre: DEBUG MARKER: == sanity test 102ha: grow xattr from inside inode to external inode == 00:20:31 (1414394431) Lustre: DEBUG MARKER: /usr/sbin/lctl mark save trusted.big on \/mnt\/lustre\/f102ha.sanity Lustre: DEBUG MARKER: save trusted.big on /mnt/lustre/f102ha.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark save trusted.sml on \/mnt\/lustre\/f102ha.sanity Lustre: DEBUG MARKER: save trusted.sml on /mnt/lustre/f102ha.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark grow trusted.sml on \/mnt\/lustre\/f102ha.sanity Lustre: DEBUG MARKER: grow trusted.sml on /mnt/lustre/f102ha.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark trusted.big still valid after growing trusted.sml Lustre: DEBUG MARKER: trusted.big still valid after growing trusted.sml Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102i: lgetxattr test on symbolic link ============== 00:20:35 \(1414394435\) Lustre: DEBUG MARKER: == sanity test 102i: lgetxattr test on symbolic link ============== 00:20:35 (1414394435) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102j: non-root tar restore stripe info from tarfile, not keep osts ===== 00:20:36 \(1414394436\) Lustre: DEBUG MARKER: == sanity test 102j: non-root tar restore stripe info from tarfile, not keep osts ===== 00:20:36 (1414394436) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102k: setfattr without parameter of value shouldn\'t cause a crash == 00:20:41 \(1414394441\) Lustre: DEBUG MARKER: == sanity test 102k: setfattr without parameter of value shouldn't cause a crash == 00:20:41 (1414394441) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102l: listxattr size test ==================================== 00:20:43 \(1414394443\) Lustre: DEBUG MARKER: == sanity test 102l: listxattr size test ==================================== 00:20:43 (1414394443) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102m: Ensure listxattr fails on small bufffer ========== 00:20:44 \(1414394444\) Lustre: DEBUG MARKER: == sanity test 102m: Ensure listxattr fails on small bufffer ========== 00:20:44 (1414394444) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 102n: silently ignore setxattr on internal trusted xattrs == 00:20:46 \(1414394446\) Lustre: DEBUG MARKER: == sanity test 102n: silently ignore setxattr on internal trusted xattrs == 00:20:46 (1414394446) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_102n MDT \< 2.5.50 allows setxattr on internal trusted xattrs Lustre: DEBUG MARKER: SKIP: sanity test_102n MDT < 2.5.50 allows setxattr on internal trusted xattrs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 103a: acl test =========================================== 00:20:48 \(1414394448\) Lustre: DEBUG MARKER: == sanity test 103a: acl test =========================================== 00:20:48 (1414394448) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 103b: MDS mount option \'noacl\' == 00:21:26 \(1414394486\) Lustre: DEBUG MARKER: == sanity test 103b: MDS mount option 'noacl' == 00:21:26 (1414394486) LustreError: 11-0: lustre-MDT0000-lwp-OST0000: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: 8926:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414394490/real 1414394490] req@ffff88006d949c00 x1483094239505436/t0(0) o400->MGC10.100.4.133@tcp@10.100.4.133@tcp:26/25 lens 224/224 e 0 to 1 dl 1414394497 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 8926:0:(client.c:1918:ptlrpc_expire_one_request()) Skipped 1 previous similar message LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414394497/real 1414394497] req@ffff880045c1c000 x1483094239505460/t0(0) o250->MGC10.100.4.133@tcp@10.100.4.133@tcp:26/25 lens 400/544 e 0 to 1 dl 1414394503 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: Evicted from MGS (at 10.100.4.133@tcp) after server handle changed from 0x1bd47fffbe5473f3 to 0x1bd47fffbee531b6 Lustre: MGC10.100.4.133@tcp: Connection restored to MGS (at 10.100.4.133@tcp) Lustre: Skipped 1 previous similar message Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414394497/real 1414394497] req@ffff880045c1c800 x1483094239505464/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414394508 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 LustreError: 167-0: lustre-MDT0000-lwp-OST0000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to lustre-MDT0000 (at 10.100.4.133@tcp) Lustre: lustre-OST0000: deleting orphan objects from 0x0:5961 to 0x0:5985 Lustre: lustre-OST0001: deleting orphan objects from 0x0:6883 to 0x0:6913 LustreError: 11-0: lustre-MDT0000-lwp-OST0001: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 103c: \'cp -rp\' won\'t set empty acl == 00:22:12 \(1414394532\) LustreError: 11-0: MGC10.100.4.133@tcp: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.100.4.133@tcp) after server handle changed from 0x1bd47fffbee531b6 to 0x1bd47fffbee5343a Lustre: MGC10.100.4.133@tcp: Connection restored to MGS (at 10.100.4.133@tcp) Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: == sanity test 103c: 'cp -rp' won't set empty acl == 00:22:12 (1414394532) Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414394527/real 1414394527] req@ffff88006516ec00 x1483094239505616/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414394548 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) Skipped 1 previous similar message LustreError: 167-0: lustre-MDT0000-lwp-OST0000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to lustre-MDT0000 (at 10.100.4.133@tcp) Lustre: lustre-OST0000: deleting orphan objects from 0x0:5987 to 0x0:6017 Lustre: lustre-OST0001: deleting orphan objects from 0x0:6883 to 0x0:6945 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 104a: lfs df [-ih] [path] test =========================== 00:22:34 \(1414394554\) Lustre: DEBUG MARKER: == sanity test 104a: lfs df [-ih] [path] test =========================== 00:22:34 (1414394554) Lustre: lustre-OST0000: Client d6432fe3-5cf6-4bb6-9fec-b454156ea77b (at 10.100.4.127@tcp) reconnecting Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST0000-osc-ffff88007db23400.ost_server_uuid in FULL state after 0 sec Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff88007db23400.ost_server_uuid in FULL state after 0 sec Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 104b: runas -u 500 -g 500 lfs check servers test ====================== 00:22:37 \(1414394557\) Lustre: DEBUG MARKER: == sanity test 104b: runas -u 500 -g 500 lfs check servers test ====================== 00:22:37 (1414394557) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 105a: flock when mounted without -o flock test ========== 00:22:38 \(1414394558\) Lustre: DEBUG MARKER: == sanity test 105a: flock when mounted without -o flock test ========== 00:22:38 (1414394558) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 105b: fcntl when mounted without -o flock test ========== 00:22:39 \(1414394559\) Lustre: DEBUG MARKER: == sanity test 105b: fcntl when mounted without -o flock test ========== 00:22:39 (1414394559) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 105c: lockf when mounted without -o flock test ========== 00:22:41 \(1414394561\) Lustre: DEBUG MARKER: == sanity test 105c: lockf when mounted without -o flock test ========== 00:22:41 (1414394561) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 105d: flock race \(should not freeze\) ========== 00:22:42 \(1414394562\) Lustre: DEBUG MARKER: == sanity test 105d: flock race (should not freeze) ========== 00:22:42 (1414394562) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 105e: Two conflicting flocks from same process ========= 00:22:53 \(1414394573\) Lustre: DEBUG MARKER: == sanity test 105e: Two conflicting flocks from same process ========= 00:22:53 (1414394573) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 106: attempt exec of dir followed by chown of that dir == 00:22:55 \(1414394575\) Lustre: DEBUG MARKER: == sanity test 106: attempt exec of dir followed by chown of that dir == 00:22:55 (1414394575) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 107: Coredump on SIG == 00:22:56 \(1414394576\) Lustre: DEBUG MARKER: == sanity test 107: Coredump on SIG == 00:22:56 (1414394576) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 110: filename length checking == 00:22:59 \(1414394579\) Lustre: DEBUG MARKER: == sanity test 110: filename length checking == 00:22:59 (1414394579) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 115: verify dynamic thread creation====================== 00:23:00 \(1414394580\) Lustre: DEBUG MARKER: == sanity test 115: verify dynamic thread creation====================== 00:23:00 (1414394580) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_115 no OSS threads Lustre: DEBUG MARKER: SKIP: sanity test_115 no OSS threads Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 116a: stripe QOS: free space balance ===================== 00:23:02 \(1414394582\) Lustre: DEBUG MARKER: == sanity test 116a: stripe QOS: free space balance ===================== 00:23:02 (1414394582) format at ldlm_pool.c:628:ldlm_pool_recalc doesn't end in newline Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 116b: QoS shouldn\'t LBUG if not enough OSTs found on the 2nd pass == 00:37:02 \(1414395422\) Lustre: DEBUG MARKER: == sanity test 116b: QoS shouldn't LBUG if not enough OSTs found on the 2nd pass == 00:37:02 (1414395422) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_116b no QOS Lustre: DEBUG MARKER: SKIP: sanity test_116b no QOS Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 117: verify fsfilt_extend ============ 00:37:04 \(1414395424\) Lustre: DEBUG MARKER: == sanity test 117: verify fsfilt_extend ============ 00:37:04 (1414395424) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118a: verify O_SYNC works ============ 00:37:06 \(1414395426\) Lustre: DEBUG MARKER: == sanity test 118a: verify O_SYNC works ============ 00:37:06 (1414395426) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118b: Reclaim dirty pages on fatal error ============ 00:37:11 \(1414395431\) Lustre: DEBUG MARKER: == sanity test 118b: Reclaim dirty pages on fatal error ============ 00:37:11 (1414395431) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x217 Lustre: *** cfs_fail_loc=217, val=0*** Lustre: Skipped 3 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ============ 00:37:17 \(1414395437\) Lustre: DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ============ 00:37:17 (1414395437) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x216 LustreError: 8953:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 216 sleeping for 1000ms LustreError: 8953:0:(fail.c:137:__cfs_fail_timeout_set()) cfs_fail_timeout id 216 awake Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118d: Fsync validation inject a delay of the bulk ============ 00:37:22 \(1414395442\) Lustre: DEBUG MARKER: == sanity test 118d: Fsync validation inject a delay of the bulk ============ 00:37:22 (1414395442) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x214 LustreError: 8953:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 sleeping for 5000ms LustreError: 8953:0:(fail.c:137:__cfs_fail_timeout_set()) cfs_fail_timeout id 214 awake Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118f: Simulate unrecoverable OSC side error ============ 00:37:32 \(1414395452\) Lustre: DEBUG MARKER: == sanity test 118f: Simulate unrecoverable OSC side error ============ 00:37:32 (1414395452) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118g: Don\'t stay in wait if we got local -ENOMEM ============ 00:37:35 \(1414395455\) Lustre: DEBUG MARKER: == sanity test 118g: Don't stay in wait if we got local -ENOMEM ============ 00:37:35 (1414395455) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118h: Verify timeout in handling recoverables errors ============ 00:37:38 \(1414395458\) Lustre: DEBUG MARKER: == sanity test 118h: Verify timeout in handling recoverables errors ============ 00:37:38 (1414395458) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x20e Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: Skipped 1 previous similar message Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: Skipped 1 previous similar message Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118i: Fix error before timeout in recoverable error ============ 00:38:36 \(1414395516\) Lustre: DEBUG MARKER: == sanity test 118i: Fix error before timeout in recoverable error ============ 00:38:36 (1414395516) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x20e Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118j: Simulate unrecoverable OST side error ============ 00:38:47 \(1414395527\) Lustre: DEBUG MARKER: == sanity test 118j: Simulate unrecoverable OST side error ============ 00:38:47 (1414395527) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x220 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118k: bio alloc -ENOMEM and IO TERM handling =========== 00:38:51 \(1414395531\) Lustre: DEBUG MARKER: == sanity test 118k: bio alloc -ENOMEM and IO TERM handling =========== 00:38:51 (1414395531) Lustre: DEBUG MARKER: lctl set_param fail_loc=0x20e Lustre: *** cfs_fail_loc=20e, val=0*** Lustre: Skipped 40 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118l: fsync dir =========== 00:39:18 \(1414395558\) Lustre: DEBUG MARKER: == sanity test 118l: fsync dir =========== 00:39:18 (1414395558) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 118m: fdatasync dir =========== 00:39:20 \(1414395560\) Lustre: DEBUG MARKER: == sanity test 118m: fdatasync dir =========== 00:39:20 (1414395560) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 119a: Short directIO read must return actual read amount == 00:39:23 \(1414395563\) Lustre: DEBUG MARKER: == sanity test 119a: Short directIO read must return actual read amount == 00:39:23 (1414395563) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 119b: Sparse directIO read must return actual read amount == 00:39:32 \(1414395572\) Lustre: DEBUG MARKER: == sanity test 119b: Sparse directIO read must return actual read amount == 00:39:32 (1414395572) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 119c: Testing for direct read hitting hole == 00:39:34 \(1414395574\) Lustre: DEBUG MARKER: == sanity test 119c: Testing for direct read hitting hole == 00:39:34 (1414395574) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 119d: The DIO path should try to send a new rpc once one is completed == 00:39:37 \(1414395577\) Lustre: DEBUG MARKER: == sanity test 119d: The DIO path should try to send a new rpc once one is completed == 00:39:37 (1414395577) Lustre: DEBUG MARKER: /usr/sbin/lctl mark the DIO writes have completed, now wait for the reads \(should not block very long\) Lustre: DEBUG MARKER: the DIO writes have completed, now wait for the reads (should not block very long) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120a: Early Lock Cancel: mkdir test == 00:39:44 \(1414395584\) Lustre: DEBUG MARKER: == sanity test 120a: Early Lock Cancel: mkdir test == 00:39:44 (1414395584) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120b: Early Lock Cancel: create test == 00:39:46 \(1414395586\) Lustre: DEBUG MARKER: == sanity test 120b: Early Lock Cancel: create test == 00:39:46 (1414395586) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120c: Early Lock Cancel: link test == 00:39:47 \(1414395587\) Lustre: DEBUG MARKER: == sanity test 120c: Early Lock Cancel: link test == 00:39:47 (1414395587) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120d: Early Lock Cancel: setattr test == 00:39:49 \(1414395589\) Lustre: DEBUG MARKER: == sanity test 120d: Early Lock Cancel: setattr test == 00:39:49 (1414395589) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120e: Early Lock Cancel: unlink test == 00:39:50 \(1414395590\) Lustre: DEBUG MARKER: == sanity test 120e: Early Lock Cancel: unlink test == 00:39:50 (1414395590) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120f: Early Lock Cancel: rename test == 00:39:53 \(1414395593\) Lustre: DEBUG MARKER: == sanity test 120f: Early Lock Cancel: rename test == 00:39:53 (1414395593) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 120g: Early Lock Cancel: performance test == 00:39:57 \(1414395597\) Lustre: DEBUG MARKER: == sanity test 120g: Early Lock Cancel: performance test == 00:39:57 (1414395597) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 121: read cancel race =========== 00:41:37 \(1414395697\) Lustre: DEBUG MARKER: == sanity test 121: read cancel race =========== 00:41:37 (1414395697) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 123a: verify statahead work == 00:41:40 \(1414395700\) Lustre: DEBUG MARKER: == sanity test 123a: verify statahead work == 00:41:40 (1414395700) Lustre: DEBUG MARKER: /usr/sbin/lctl mark testing on UP system. Performance may be not as good as expected. Lustre: DEBUG MARKER: testing on UP system. Performance may be not as good as expected. Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls 100 files without statahead: 0 sec Lustre: DEBUG MARKER: ls 100 files without statahead: 0 sec Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls 100 files with statahead: 1 sec Lustre: DEBUG MARKER: ls 100 files with statahead: 1 sec Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls 1000 files without statahead: 6 sec Lustre: DEBUG MARKER: ls 1000 files without statahead: 6 sec Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls 1000 files with statahead: 5 sec Lustre: DEBUG MARKER: ls 1000 files with statahead: 5 sec Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls 10000 files without statahead: 61 sec Lustre: DEBUG MARKER: ls 10000 files without statahead: 61 sec format at ldlm_pool.c:628:ldlm_pool_recalc doesn't end in newline Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls 10000 files with statahead: 53 sec Lustre: DEBUG MARKER: ls 10000 files with statahead: 53 sec Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls done Lustre: DEBUG MARKER: ls done Lustre: DEBUG MARKER: /usr/sbin/lctl mark rm -r \/mnt\/lustre\/d123a.sanity\/: 31 seconds Lustre: DEBUG MARKER: rm -r /mnt/lustre/d123a.sanity/: 31 seconds Lustre: DEBUG MARKER: /usr/sbin/lctl mark rm done Lustre: DEBUG MARKER: rm done Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 123b: not panic with network error in statahead enqueue \(bug 15027\) == 00:45:16 \(1414395916\) Lustre: DEBUG MARKER: == sanity test 123b: not panic with network error in statahead enqueue (bug 15027) == 00:45:16 (1414395916) Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls done Lustre: DEBUG MARKER: ls done Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 124a: lru resize ========================================= 00:45:31 \(1414395931\) Lustre: DEBUG MARKER: == sanity test 124a: lru resize ========================================= 00:45:31 (1414395931) Lustre: DEBUG MARKER: /usr/sbin/lctl mark create 2000 files at \/mnt\/lustre\/d124a.sanity Lustre: DEBUG MARKER: create 2000 files at /mnt/lustre/d124a.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark NSDIR=ldlm.namespaces.lustre-MDT0000-mdc-ffff88007db23400 Lustre: DEBUG MARKER: NSDIR=ldlm.namespaces.lustre-MDT0000-mdc-ffff88007db23400 Lustre: DEBUG MARKER: /usr/sbin/lctl mark NS=ldlm.namespaces.lustre-MDT0000-mdc-ffff88007db23400 Lustre: DEBUG MARKER: NS=ldlm.namespaces.lustre-MDT0000-mdc-ffff88007db23400 Lustre: DEBUG MARKER: /usr/sbin/lctl mark LRU=2003 Lustre: DEBUG MARKER: LRU=2003 Lustre: DEBUG MARKER: /usr/sbin/lctl mark LIMIT=93830 Lustre: DEBUG MARKER: LIMIT=93830 Lustre: DEBUG MARKER: /usr/sbin/lctl mark LVF=56213 Lustre: DEBUG MARKER: LVF=56213 Lustre: DEBUG MARKER: /usr/sbin/lctl mark OLD_LVF=1 Lustre: DEBUG MARKER: OLD_LVF=1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Sleep 50 sec Lustre: DEBUG MARKER: Sleep 50 sec Lustre: DEBUG MARKER: /usr/sbin/lctl mark Dropped 891 locks in 50s Lustre: DEBUG MARKER: Dropped 891 locks in 50s Lustre: DEBUG MARKER: /usr/sbin/lctl mark unlink 2000 files at \/mnt\/lustre\/d124a.sanity Lustre: DEBUG MARKER: unlink 2000 files at /mnt/lustre/d124a.sanity Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 124b: lru resize \(performance test\) ========================= 00:46:55 \(1414396015\) Lustre: DEBUG MARKER: == sanity test 124b: lru resize (performance test) ========================= 00:46:55 (1414396015) Lustre: DEBUG MARKER: /usr/sbin/lctl mark doing ls -la \/mnt\/lustre\/d124b.sanity\/disable_lru_resize 3 times Lustre: DEBUG MARKER: doing ls -la /mnt/lustre/d124b.sanity/disable_lru_resize 3 times Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls -la time: 9 seconds Lustre: DEBUG MARKER: ls -la time: 9 seconds Lustre: DEBUG MARKER: /usr/sbin/lctl mark lru_size = 100 Lustre: DEBUG MARKER: lru_size = 100 Lustre: DEBUG MARKER: /usr/sbin/lctl mark doing ls -la \/mnt\/lustre\/d124b.sanity\/enable_lru_resize 3 times Lustre: DEBUG MARKER: doing ls -la /mnt/lustre/d124b.sanity/enable_lru_resize 3 times Lustre: DEBUG MARKER: /usr/sbin/lctl mark ls -la time: 9 seconds Lustre: DEBUG MARKER: ls -la time: 9 seconds Lustre: DEBUG MARKER: /usr/sbin/lctl mark lru_size = 2006 Lustre: DEBUG MARKER: lru_size = 2006 Lustre: DEBUG MARKER: /usr/sbin/lctl mark lru resize performs the same with no lru resize Lustre: DEBUG MARKER: lru resize performs the same with no lru resize Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 125: don\'t return EPROTO when a dir has a non-default striping and ACLs == 00:47:51 \(1414396071\) Lustre: DEBUG MARKER: == sanity test 125: don't return EPROTO when a dir has a non-default striping and ACLs == 00:47:51 (1414396071) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 126: check that the fsgid provided by the client is taken into account == 00:47:53 \(1414396073\) Lustre: DEBUG MARKER: == sanity test 126: check that the fsgid provided by the client is taken into account == 00:47:53 (1414396073) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 127a: verify the client stats are sane == 00:47:55 \(1414396075\) Lustre: DEBUG MARKER: == sanity test 127a: verify the client stats are sane == 00:47:55 (1414396075) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 127b: verify the llite client stats are sane == 00:47:58 \(1414396078\) Lustre: DEBUG MARKER: == sanity test 127b: verify the llite client stats are sane == 00:47:58 (1414396078) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 128: interactive lfs for 2 consecutive find\'s == 00:48:01 \(1414396081\) Lustre: DEBUG MARKER: == sanity test 128: interactive lfs for 2 consecutive find's == 00:48:01 (1414396081) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 129: test directory size limit ========================== 00:48:03 \(1414396083\) Lustre: DEBUG MARKER: == sanity test 129: test directory size limit ========================== 00:48:03 (1414396083) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_129 Only applicable to ldiskfs-based MDTs Lustre: DEBUG MARKER: SKIP: sanity test_129 Only applicable to ldiskfs-based MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 130a: FIEMAP \(1-stripe file\) == 00:48:05 \(1414396085\) Lustre: DEBUG MARKER: == sanity test 130a: FIEMAP (1-stripe file) == 00:48:05 (1414396085) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_130a ORI-366\/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: SKIP: sanity test_130a ORI-366/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 130b: FIEMAP \(2-stripe file\) == 00:48:08 \(1414396088\) Lustre: DEBUG MARKER: == sanity test 130b: FIEMAP (2-stripe file) == 00:48:08 (1414396088) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_130b ORI-366\/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: SKIP: sanity test_130b ORI-366/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 130c: FIEMAP \(2-stripe file with hole\) == 00:48:10 \(1414396090\) Lustre: DEBUG MARKER: == sanity test 130c: FIEMAP (2-stripe file with hole) == 00:48:10 (1414396090) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_130c ORI-366\/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: SKIP: sanity test_130c ORI-366/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 130d: FIEMAP \(N-stripe file\) == 00:48:12 \(1414396092\) Lustre: DEBUG MARKER: == sanity test 130d: FIEMAP (N-stripe file) == 00:48:12 (1414396092) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_130d skipping FIEMAP on N-stripe file test Lustre: DEBUG MARKER: SKIP: sanity test_130d skipping FIEMAP on N-stripe file test Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 130e: FIEMAP \(test continuation FIEMAP calls\) == 00:48:14 \(1414396094\) Lustre: DEBUG MARKER: == sanity test 130e: FIEMAP (test continuation FIEMAP calls) == 00:48:14 (1414396094) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_130e ORI-366\/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: SKIP: sanity test_130e ORI-366/LU-1941: FIEMAP unimplemented on ZFS Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 131a: test iov\'s crossing stripe boundary for writev\/readv == 00:48:16 \(1414396096\) Lustre: DEBUG MARKER: == sanity test 131a: test iov's crossing stripe boundary for writev/readv == 00:48:16 (1414396096) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 131b: test append writev == 00:48:18 \(1414396098\) Lustre: DEBUG MARKER: == sanity test 131b: test append writev == 00:48:18 (1414396098) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 131c: test read\/write on file w\/o objects == 00:48:20 \(1414396100\) Lustre: DEBUG MARKER: == sanity test 131c: test read/write on file w/o objects == 00:48:20 (1414396100) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 131d: test short read == 00:48:21 \(1414396101\) Lustre: DEBUG MARKER: == sanity test 131d: test short read == 00:48:21 (1414396101) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 131e: test read hitting hole == 00:48:23 \(1414396103\) Lustre: DEBUG MARKER: == sanity test 131e: test read hitting hole == 00:48:23 (1414396103) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 132: som avoids glimpse rpc == 00:48:24 \(1414396104\) Lustre: DEBUG MARKER: == sanity test 132: som avoids glimpse rpc == 00:48:24 (1414396104) Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n ost.OSS.ost.stats Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n ost.OSS.ost.stats LustreError: 11-0: lustre-MDT0000-lwp-OST0001: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: grep -c /mnt/ost1' ' /proc/mounts Lustre: DEBUG MARKER: umount -d -f /mnt/ost1 Lustre: 8944:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396117/real 1414396117] req@ffff880066baf800 x1483094239582760/t0(0) o101->MGC10.100.4.133@tcp@10.100.4.133@tcp:26/25 lens 328/344 e 0 to 1 dl 1414396124 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 Lustre: 8944:0:(client.c:1918:ptlrpc_expire_one_request()) Skipped 1 previous similar message LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: server umount lustre-OST0000 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' Lustre: DEBUG MARKER: ! zpool list -H lustre-ost1 >/dev/null 2>&1 || grep -q ^lustre-ost1/ /proc/mounts || zpool export lustre-ost1 Lustre: DEBUG MARKER: grep -c /mnt/ost2' ' /proc/mounts Lustre: DEBUG MARKER: umount -d -f /mnt/ost2 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396124/real 1414396124] req@ffff880066baf000 x1483094239582772/t0(0) o250->MGC10.100.4.133@tcp@10.100.4.133@tcp:26/25 lens 400/544 e 0 to 1 dl 1414396130 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' Lustre: DEBUG MARKER: ! zpool list -H lustre-ost2 >/dev/null 2>&1 || grep -q ^lustre-ost2/ /proc/mounts || zpool export lustre-ost2 Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost1' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost1' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost2' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost2' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: mkdir -p /mnt/ost1 Lustre: DEBUG MARKER: zpool list -H lustre-ost1 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost1 Lustre: DEBUG MARKER: mkdir -p /mnt/ost1; mount -t lustre lustre-ost1/ost1 /mnt/ost1 LustreError: 137-5: lustre-OST0001_UUID: not available for connect from 10.100.4.133@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null Lustre: DEBUG MARKER: mkdir -p /mnt/ost2 Lustre: DEBUG MARKER: zpool list -H lustre-ost2 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost2 Lustre: lustre-OST0000: deleting orphan objects from 0x0:25861 to 0x0:25889 LustreError: 137-5: lustre-OST0001_UUID: not available for connect from 10.100.4.133@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: DEBUG MARKER: mkdir -p /mnt/ost2; mount -t lustre lustre-ost2/ost2 /mnt/ost2 Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost2/ost2 2>/dev/null Lustre: lustre-OST0001: deleting orphan objects from 0x0:20809 to 0x0:20833 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n ost.OSS.ost.stats Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n ost.OSS.ost.stats LustreError: 11-0: lustre-MDT0000-lwp-OST0000: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: grep -c /mnt/ost1' ' /proc/mounts Lustre: DEBUG MARKER: umount -d -f /mnt/ost1 Lustre: server umount lustre-OST0000 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' Lustre: DEBUG MARKER: ! zpool list -H lustre-ost1 >/dev/null 2>&1 || grep -q ^lustre-ost1/ /proc/mounts || zpool export lustre-ost1 Lustre: DEBUG MARKER: grep -c /mnt/ost2' ' /proc/mounts Lustre: DEBUG MARKER: umount -d -f /mnt/ost2 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396191/real 1414396191] req@ffff880026163000 x1483094239583148/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414396202 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396206/real 1414396206] req@ffff8800264b8000 x1483094239583164/t0(0) o38->lustre-MDT0000-lwp-OST0001@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414396222 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 10776:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396185/real 1414396185] req@ffff8800264b8800 x1483094239583136/t0(0) o101->MGC10.100.4.133@tcp@10.100.4.133@tcp:26/25 lens 328/344 e 0 to 1 dl 1414396229 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' Lustre: DEBUG MARKER: ! zpool list -H lustre-ost2 >/dev/null 2>&1 || grep -q ^lustre-ost2/ /proc/mounts || zpool export lustre-ost2 Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost1' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost1' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost2' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost2' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: mkdir -p /mnt/ost1 Lustre: DEBUG MARKER: zpool list -H lustre-ost1 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost1 Lustre: DEBUG MARKER: mkdir -p /mnt/ost1; mount -t lustre lustre-ost1/ost1 /mnt/ost1 LustreError: 137-5: lustre-OST0001_UUID: not available for connect from 10.100.4.133@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null Lustre: DEBUG MARKER: mkdir -p /mnt/ost2 Lustre: DEBUG MARKER: zpool list -H lustre-ost2 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost2 Lustre: lustre-OST0000: deleting orphan objects from 0x0:25861 to 0x0:25921 Lustre: DEBUG MARKER: mkdir -p /mnt/ost2; mount -t lustre lustre-ost2/ost2 /mnt/ost2 LustreError: 137-5: lustre-OST0001_UUID: not available for connect from 10.100.4.133@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost2/ost2 2>/dev/null Lustre: lustre-OST0001: deleting orphan objects from 0x0:20835 to 0x0:20865 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 133a: Verifying MDT stats ========================================== 00:51:20 \(1414396280\) Lustre: DEBUG MARKER: == sanity test 133a: Verifying MDT stats ========================================== 00:51:20 (1414396280) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param obdfilter.*.stats=clear Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 133b: Verifying extra MDT stats ==================================== 00:51:25 \(1414396285\) Lustre: DEBUG MARKER: == sanity test 133b: Verifying extra MDT stats ==================================== 00:51:25 (1414396285) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param obdfilter.*.stats=clear Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 133c: Verifying OST stats ========================================== 00:51:28 \(1414396288\) Lustre: DEBUG MARKER: == sanity test 133c: Verifying OST stats ========================================== 00:51:28 (1414396288) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param obdfilter.*.stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl get_param obdfilter.lustre-OST0000.stats Lustre: DEBUG MARKER: /usr/sbin/lctl get_param obdfilter.lustre-OST0000.stats Lustre: DEBUG MARKER: /usr/sbin/lctl get_param obdfilter.lustre-OST0000.stats Lustre: DEBUG MARKER: /usr/sbin/lctl get_param obdfilter.lustre-OST0000.stats Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 133d: Verifying rename_stats ========================================== 00:51:55 \(1414396315\) Lustre: DEBUG MARKER: == sanity test 133d: Verifying rename_stats ========================================== 00:51:55 (1414396315) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 133e: Verifying OST {read,write}_bytes nid stats =================== 00:52:04 \(1414396324\) Lustre: DEBUG MARKER: == sanity test 133e: Verifying OST read_bytes write_bytes nid stats =================== 00:52:04 (1414396324) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.*.exports.clear=clear Lustre: DEBUG MARKER: /usr/sbin/lctl get_param obdfilter.*.exports.*.stats Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.*.exports.clear=clear Lustre: DEBUG MARKER: /usr/sbin/lctl get_param obdfilter.*.exports.*.stats Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 133f: Check for LBUGs\/Oopses\/unreadable files in \/proc == 00:52:08 \(1414396328\) Lustre: DEBUG MARKER: == sanity test 133f: Check for LBUGs/Oopses/unreadable files in /proc == 00:52:08 (1414396328) Lustre: DEBUG MARKER: find /proc/fs/lustre/ /proc/sys/lnet/ /proc/sys/lustre/ ! -name req_history -exec cat {} \; Lustre: DEBUG MARKER: find /proc/fs/lustre/ /proc/sys/lnet/ /proc/sys/lustre/ ! -name req_history -type f -exec cat {} \; Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 140: Check reasonable stack depth \(shouldn\'t LBUG\) ====== 00:52:13 \(1414396333\) Lustre: DEBUG MARKER: == sanity test 140: Check reasonable stack depth (shouldn't LBUG) ====== 00:52:13 (1414396333) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 150: truncate\/append tests == 00:52:15 \(1414396335\) Lustre: DEBUG MARKER: == sanity test 150: truncate/append tests == 00:52:15 (1414396335) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 151: test cache on oss and controls ================================= 00:52:22 \(1414396342\) Lustre: DEBUG MARKER: == sanity test 151: test cache on oss and controls ================================= 00:52:22 (1414396342) Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n obdfilter.lustre-OST*.read_cache_enable osd-*.lustre-OST*.read_cache_enable 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 152: test read\/write with enomem ============================== 00:52:24 \(1414396344\) Lustre: DEBUG MARKER: == sanity test 152: test read/write with enomem ============================== 00:52:24 (1414396344) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 153: test if fdatasync does not crash ========================= 00:52:27 \(1414396347\) Lustre: DEBUG MARKER: == sanity test 153: test if fdatasync does not crash ========================= 00:52:27 (1414396347) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 154A: lfs path2fid and fid2path basic checks == 00:52:30 \(1414396350\) Lustre: DEBUG MARKER: == sanity test 154A: lfs path2fid and fid2path basic checks == 00:52:30 (1414396350) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 154a: Open-by-FID == 00:52:31 \(1414396351\) Lustre: DEBUG MARKER: == sanity test 154a: Open-by-FID == 00:52:31 (1414396351) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 154b: Open-by-FID for remote directory == 00:52:34 \(1414396354\) Lustre: DEBUG MARKER: == sanity test 154b: Open-by-FID for remote directory == 00:52:34 (1414396354) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_154b needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_154b needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 154c: lfs path2fid and fid2path multiple arguments == 00:52:37 \(1414396357\) Lustre: DEBUG MARKER: == sanity test 154c: lfs path2fid and fid2path multiple arguments == 00:52:37 (1414396357) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 154d: Verify open file fid == 00:52:39 \(1414396359\) Lustre: DEBUG MARKER: == sanity test 154d: Verify open file fid == 00:52:39 (1414396359) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_154d Need MDS version at least 2.5.53 Lustre: DEBUG MARKER: SKIP: sanity test_154d Need MDS version at least 2.5.53 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155a: Verify small file correctness: read cache:on write_cache:on == 00:52:41 \(1414396361\) Lustre: DEBUG MARKER: == sanity test 155a: Verify small file correctness: read cache:on write_cache:on == 00:52:41 (1414396361) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=1 osd-*.lustre-OST*.read_cache_enable=1 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=1 osd-*.lustre-OST*.writethrough_cache_enable=1 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155b: Verify small file correctness: read cache:on write_cache:off == 00:52:44 \(1414396364\) Lustre: DEBUG MARKER: == sanity test 155b: Verify small file correctness: read cache:on write_cache:off == 00:52:44 (1414396364) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=1 osd-*.lustre-OST*.read_cache_enable=1 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=0 osd-*.lustre-OST*.writethrough_cache_enable=0 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155c: Verify small file correctness: read cache:off write_cache:on == 00:52:48 \(1414396368\) Lustre: DEBUG MARKER: == sanity test 155c: Verify small file correctness: read cache:off write_cache:on == 00:52:48 (1414396368) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=0 osd-*.lustre-OST*.read_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=1 osd-*.lustre-OST*.writethrough_cache_enable=1 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155d: Verify small file correctness: read cache:off write_cache:off == 00:52:52 \(1414396372\) Lustre: DEBUG MARKER: == sanity test 155d: Verify small file correctness: read cache:off write_cache:off == 00:52:52 (1414396372) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=0 osd-*.lustre-OST*.read_cache_enable=0 2>&1 LustreError: 12678:0:(ost_handler.c:1775:ost_blocking_ast()) Error -2 syncing data on lock cancel Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=0 osd-*.lustre-OST*.writethrough_cache_enable=0 2>&1 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155e: Verify big file correctness: read cache:on write_cache:on == 00:52:57 \(1414396377\) Lustre: DEBUG MARKER: == sanity test 155e: Verify big file correctness: read cache:on write_cache:on == 00:52:57 (1414396377) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=1 osd-*.lustre-OST*.read_cache_enable=1 2>&1 LustreError: 12678:0:(ost_handler.c:1775:ost_blocking_ast()) Error -2 syncing data on lock cancel Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=1 osd-*.lustre-OST*.writethrough_cache_enable=1 2>&1 Lustre: DEBUG MARKER: awk '/cache/ {sum+=$4} END {print sum}' /proc/cpuinfo Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155f: Verify big file correctness: read cache:on write_cache:off == 00:53:07 \(1414396387\) Lustre: DEBUG MARKER: == sanity test 155f: Verify big file correctness: read cache:on write_cache:off == 00:53:07 (1414396387) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=1 osd-*.lustre-OST*.read_cache_enable=1 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=0 osd-*.lustre-OST*.writethrough_cache_enable=0 2>&1 Lustre: DEBUG MARKER: awk '/cache/ {sum+=$4} END {print sum}' /proc/cpuinfo Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155g: Verify big file correctness: read cache:off write_cache:on == 00:53:19 \(1414396399\) Lustre: DEBUG MARKER: == sanity test 155g: Verify big file correctness: read cache:off write_cache:on == 00:53:19 (1414396399) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=0 osd-*.lustre-OST*.read_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=1 osd-*.lustre-OST*.writethrough_cache_enable=1 2>&1 Lustre: DEBUG MARKER: awk '/cache/ {sum+=$4} END {print sum}' /proc/cpuinfo Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 155h: Verify big file correctness: read cache:off write_cache:off == 00:53:29 \(1414396409\) Lustre: DEBUG MARKER: == sanity test 155h: Verify big file correctness: read cache:off write_cache:off == 00:53:29 (1414396409) Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.read_cache_enable=0 osd-*.lustre-OST*.read_cache_enable=0 2>&1 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n obdfilter.lustre-OST*.writethrough_cache_enable=0 osd-*.lustre-OST*.writethrough_cache_enable=0 2>&1 Lustre: DEBUG MARKER: awk '/cache/ {sum+=$4} END {print sum}' /proc/cpuinfo Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 156: Verification of tunables ============================== 00:53:39 \(1414396419\) Lustre: DEBUG MARKER: == sanity test 156: Verification of tunables ============================== 00:53:39 (1414396419) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_156 LU-1956\/LU-2261: stats unimplemented on OSD ZFS Lustre: DEBUG MARKER: SKIP: sanity test_156 LU-1956/LU-2261: stats unimplemented on OSD ZFS Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 160a: changelog sanity == 00:53:41 \(1414396421\) Lustre: DEBUG MARKER: == sanity test 160a: changelog sanity == 00:53:41 (1414396421) LustreError: 11-0: lustre-MDT0000-lwp-OST0000: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message LustreError: 11-0: MGC10.100.4.133@tcp: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.100.4.133@tcp) after server handle changed from 0x1bd47fffbf16c50a to 0x1bd47fffbf17a4e7 Lustre: MGC10.100.4.133@tcp: Connection restored to MGS (at 10.100.4.133@tcp) Lustre: Skipped 1 previous similar message LustreError: 167-0: lustre-MDT0000-lwp-OST0000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to lustre-MDT0000 (at 10.100.4.133@tcp) Lustre: lustre-OST0000: deleting orphan objects from 0x0:26191 to 0x0:26209 Lustre: lustre-OST0001: deleting orphan objects from 0x0:21138 to 0x0:21185 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 160b: Verify that very long rename doesn\'t crash in changelog == 00:54:11 \(1414396451\) Lustre: DEBUG MARKER: == sanity test 160b: Verify that very long rename doesn't crash in changelog == 00:54:11 (1414396451) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 160c: verify that changelog log catch the truncate event == 00:54:14 \(1414396454\) Lustre: DEBUG MARKER: == sanity test 160c: verify that changelog log catch the truncate event == 00:54:14 (1414396454) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 161a: link ea sanity == 00:54:17 \(1414396457\) Lustre: DEBUG MARKER: == sanity test 161a: link ea sanity == 00:54:17 (1414396457) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 161b: link ea sanity under remote directory == 00:54:31 \(1414396471\) Lustre: DEBUG MARKER: == sanity test 161b: link ea sanity under remote directory == 00:54:31 (1414396471) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_161b skipping remote directory test Lustre: DEBUG MARKER: SKIP: sanity test_161b skipping remote directory test Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 161c: check CL_RENME[UNLINK] changelog record flags == 00:54:33 \(1414396473\) Lustre: DEBUG MARKER: == sanity test 161c: check CL_RENME[UNLINK] changelog record flags == 00:54:33 (1414396473) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 162: path lookup sanity == 00:54:35 \(1414396475\) Lustre: DEBUG MARKER: == sanity test 162: path lookup sanity == 00:54:35 (1414396475) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 169: parallel read and truncate should not deadlock == 00:54:37 \(1414396477\) Lustre: DEBUG MARKER: == sanity test 169: parallel read and truncate should not deadlock == 00:54:37 (1414396477) Lustre: DEBUG MARKER: /usr/sbin/lctl mark creating a 10 Mb file Lustre: DEBUG MARKER: creating a 10 Mb file Lustre: DEBUG MARKER: /usr/sbin/lctl mark starting reads Lustre: DEBUG MARKER: starting reads Lustre: DEBUG MARKER: /usr/sbin/lctl mark truncating the file Lustre: DEBUG MARKER: truncating the file Lustre: DEBUG MARKER: /usr/sbin/lctl mark killing dd Lustre: DEBUG MARKER: killing dd Lustre: DEBUG MARKER: /usr/sbin/lctl mark removing the temporary file Lustre: DEBUG MARKER: removing the temporary file Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 170: test lctl df to handle corrupted log ======================= 00:54:46 \(1414396486\) Lustre: DEBUG MARKER: == sanity test 170: test lctl df to handle corrupted log ======================= 00:54:46 (1414396486) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 171: test libcfs_debug_dumplog_thread stuck in do_exit\(\) ======== 00:54:50 \(1414396490\) Lustre: DEBUG MARKER: == sanity test 171: test libcfs_debug_dumplog_thread stuck in do_exit() ======== 00:54:50 (1414396490) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_180a skipping ALWAYS excluded test 180a \(base 180\) Lustre: DEBUG MARKER: SKIP: sanity test_180a skipping ALWAYS excluded test 180a (base 180) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_180b skipping ALWAYS excluded test 180b \(base 180\) Lustre: DEBUG MARKER: SKIP: sanity test_180b skipping ALWAYS excluded test 180b (base 180) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_180c skipping ALWAYS excluded test 180c \(base 180\) Lustre: DEBUG MARKER: SKIP: sanity test_180c skipping ALWAYS excluded test 180c (base 180) Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 181: Test open-unlinked dir ========================== 00:54:56 \(1414396496\) Lustre: DEBUG MARKER: == sanity test 181: Test open-unlinked dir ========================== 00:54:56 (1414396496) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 182: Disable MDC RPCs semaphore wouldn\'t crash client ================== 00:55:34 \(1414396534\) Lustre: DEBUG MARKER: == sanity test 182: Disable MDC RPCs semaphore wouldn't crash client ================== 00:55:34 (1414396534) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 183: No crash or request leak in case of strange dispositions ========== 00:55:52 \(1414396552\) Lustre: DEBUG MARKER: == sanity test 183: No crash or request leak in case of strange dispositions ========== 00:55:52 (1414396552) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 184a: Basic layout swap == 00:55:54 \(1414396554\) Lustre: DEBUG MARKER: == sanity test 184a: Basic layout swap == 00:55:54 (1414396554) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 184b: Forbidden layout swap \(will generate errors\) == 00:55:59 \(1414396559\) Lustre: DEBUG MARKER: == sanity test 184b: Forbidden layout swap (will generate errors) == 00:55:59 (1414396559) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_184c skipping ALWAYS excluded test 184c Lustre: DEBUG MARKER: SKIP: sanity test_184c skipping ALWAYS excluded test 184c Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 184d: allow stripeless layouts swap == 00:56:02 \(1414396562\) Lustre: DEBUG MARKER: == sanity test 184d: allow stripeless layouts swap == 00:56:02 (1414396562) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 185: Volatile file support == 00:56:03 \(1414396563\) Lustre: DEBUG MARKER: == sanity test 185: Volatile file support == 00:56:03 (1414396563) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 187a: Test data version change == 00:56:06 \(1414396566\) Lustre: DEBUG MARKER: == sanity test 187a: Test data version change == 00:56:06 (1414396566) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 187b: Test data version change on volatile file == 00:56:15 \(1414396575\) Lustre: DEBUG MARKER: == sanity test 187b: Test data version change on volatile file == 00:56:15 (1414396575) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 200: OST pools == 00:56:20 \(1414396580\) Lustre: DEBUG MARKER: == sanity test 200: OST pools == 00:56:20 (1414396580) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204a: Print default stripe attributes =================== 00:56:59 \(1414396619\) Lustre: DEBUG MARKER: == sanity test 204a: Print default stripe attributes =================== 00:56:59 (1414396619) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204b: Print default stripe size and offset ============= 00:57:00 \(1414396620\) Lustre: DEBUG MARKER: == sanity test 204b: Print default stripe size and offset ============= 00:57:00 (1414396620) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204c: Print default stripe count and offset ============= 00:57:02 \(1414396622\) Lustre: DEBUG MARKER: == sanity test 204c: Print default stripe count and offset ============= 00:57:02 (1414396622) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204d: Print default stripe count and size =============== 00:57:03 \(1414396623\) Lustre: DEBUG MARKER: == sanity test 204d: Print default stripe count and size =============== 00:57:03 (1414396623) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204e: Print raw stripe attributes =================== 00:57:04 \(1414396624\) Lustre: DEBUG MARKER: == sanity test 204e: Print raw stripe attributes =================== 00:57:04 (1414396624) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204f: Print raw stripe size and offset ============= 00:57:06 \(1414396626\) Lustre: DEBUG MARKER: == sanity test 204f: Print raw stripe size and offset ============= 00:57:06 (1414396626) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204g: Print raw stripe count and offset ============= 00:57:07 \(1414396627\) Lustre: DEBUG MARKER: == sanity test 204g: Print raw stripe count and offset ============= 00:57:07 (1414396627) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 204h: Print raw stripe count and size =============== 00:57:09 \(1414396629\) Lustre: DEBUG MARKER: == sanity test 204h: Print raw stripe count and size =============== 00:57:09 (1414396629) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 205: Verify job stats == 00:57:10 \(1414396630\) Lustre: DEBUG MARKER: == sanity test 205: Verify job stats == 00:57:10 (1414396630) Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: mkdir \/mnt\/lustre\/f205.sanity Lustre: DEBUG MARKER: Test: mkdir /mnt/lustre/f205.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.8602 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.8602 Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: rm -fr \/mnt\/lustre\/f205.sanity Lustre: DEBUG MARKER: Test: rm -fr /mnt/lustre/f205.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.14737 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.14737 Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: mknod \/mnt\/lustre\/f205.sanity c 1 3 Lustre: DEBUG MARKER: Test: mknod /mnt/lustre/f205.sanity c 1 3 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.4941 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.4941 Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: rm -f \/mnt\/lustre\/f205.sanity Lustre: DEBUG MARKER: Test: rm -f /mnt/lustre/f205.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.21870 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.21870 Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: \/usr\/bin\/lfs setstripe -i 0 -c 1 \/mnt\/lustre\/f205.sanity Lustre: DEBUG MARKER: Test: /usr/bin/lfs setstripe -i 0 -c 1 /mnt/lustre/f205.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.23877 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.23877 Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: touch \/mnt\/lustre\/f205.sanity Lustre: DEBUG MARKER: Test: touch /mnt/lustre/f205.sanity Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.28145 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.28145 Lustre: DEBUG MARKER: lctl get_param obdfilter.*.job_stats Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: dd if=\/dev\/zero of=\/mnt\/lustre\/f205.sanity bs=1M count=1 oflag=sync Lustre: DEBUG MARKER: Test: dd if=/dev/zero of=/mnt/lustre/f205.sanity bs=1M count=1 oflag=sync Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.7281 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.7281 Lustre: DEBUG MARKER: lctl get_param obdfilter.*.job_stats Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: dd if=\/mnt\/lustre\/f205.sanity of=\/dev\/null bs=1M count=1 iflag=direct Lustre: DEBUG MARKER: Test: dd if=/mnt/lustre/f205.sanity of=/dev/null bs=1M count=1 iflag=direct Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.20692 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.20692 Lustre: DEBUG MARKER: lctl get_param obdfilter.*.job_stats Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: \/usr\/lib64\/lustre\/tests\/truncate \/mnt\/lustre\/f205.sanity 0 Lustre: DEBUG MARKER: Test: /usr/lib64/lustre/tests/truncate /mnt/lustre/f205.sanity 0 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.16762 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.16762 Lustre: DEBUG MARKER: lctl get_param obdfilter.*.job_stats Lustre: DEBUG MARKER: lctl set_param obdfilter.*.job_stats=clear Lustre: DEBUG MARKER: /usr/sbin/lctl mark Test: mv -f \/mnt\/lustre\/f205.sanity \/mnt\/lustre\/jobstats_test_rename Lustre: DEBUG MARKER: Test: mv -f /mnt/lustre/f205.sanity /mnt/lustre/jobstats_test_rename Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using JobID environment variable FAKE_JOBID=test_id.205.19508 Lustre: DEBUG MARKER: Using JobID environment variable FAKE_JOBID=test_id.205.19508 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 206: fail lov_init_raid0\(\) doesn\'t lbug == 00:57:46 \(1414396666\) Lustre: DEBUG MARKER: == sanity test 206: fail lov_init_raid0() doesn't lbug == 00:57:46 (1414396666) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 207a: can refresh layout at glimpse == 00:57:47 \(1414396667\) Lustre: DEBUG MARKER: == sanity test 207a: can refresh layout at glimpse == 00:57:47 (1414396667) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 207b: can refresh layout at open == 00:57:49 \(1414396669\) Lustre: DEBUG MARKER: == sanity test 207b: can refresh layout at open == 00:57:49 (1414396669) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 208: Exclusive open == 00:57:52 \(1414396672\) Lustre: DEBUG MARKER: == sanity test 208: Exclusive open == 00:57:52 (1414396672) LustreError: 11-0: lustre-MDT0000-lwp-OST0001: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message LustreError: 11-0: MGC10.100.4.133@tcp: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: Skipped 1 previous similar message LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.100.4.133@tcp) after server handle changed from 0x1bd47fffbf17a4e7 to 0x1bd47fffbf23a86b Lustre: MGC10.100.4.133@tcp: Connection restored to MGS (at 10.100.4.133@tcp) Lustre: Skipped 1 previous similar message Lustre: lustre-OST0000: deleting orphan objects from 0x0:30241 to 0x0:30273 Lustre: lustre-OST0001: deleting orphan objects from 0x0:25204 to 0x0:25249 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396690/real 1414396690] req@ffff88002604a000 x1483094239585228/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414396711 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) Skipped 1 previous similar message LustreError: 11-0: MGC10.100.4.133@tcp: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. LustreError: 166-1: MGC10.100.4.133@tcp: Connection to MGS (at 10.100.4.133@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.100.4.133@tcp) after server handle changed from 0x1bd47fffbf23a86b to 0x1bd47fffbf23ac2a Lustre: MGC10.100.4.133@tcp: Connection restored to MGS (at 10.100.4.133@tcp) Lustre: lustre-OST0000: deleting orphan objects from 0x0:30241 to 0x0:30305 Lustre: lustre-OST0001: deleting orphan objects from 0x0:25204 to 0x0:25281 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 209: read-only open\/close requests should be freed promptly == 00:59:09 \(1414396749\) Lustre: DEBUG MARKER: == sanity test 209: read-only open/close requests should be freed promptly == 00:59:09 (1414396749) Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414396725/real 1414396725] req@ffff88004e9b2400 x1483094239585380/t0(0) o38->lustre-MDT0000-lwp-OST0000@10.100.4.133@tcp:12/10 lens 400/544 e 0 to 1 dl 1414396750 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 8924:0:(client.c:1918:ptlrpc_expire_one_request()) Skipped 1 previous similar message LustreError: 167-0: lustre-MDT0000-lwp-OST0000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to lustre-MDT0000 (at 10.100.4.133@tcp) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 212: Sendfile test ============================================== 00:59:20 \(1414396760\) Lustre: DEBUG MARKER: == sanity test 212: Sendfile test ============================================== 00:59:20 (1414396760) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 213: OSC lock completion and cancel race don\'t crash - bug 18829 == 00:59:24 \(1414396764\) Lustre: DEBUG MARKER: == sanity test 213: OSC lock completion and cancel race don't crash - bug 18829 == 00:59:24 (1414396764) LustreError: 14158:0:(ost_handler.c:1775:ost_blocking_ast()) Error -2 syncing data on lock cancel Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 214: hash-indexed directory test - bug 20133 == 00:59:31 \(1414396771\) Lustre: DEBUG MARKER: == sanity test 214: hash-indexed directory test - bug 20133 == 00:59:31 (1414396771) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 215: \/proc\/sys\/lnet exists and has proper content - bugs 18102, 21079, 21517 == 00:59:39 \(1414396779\) Lustre: DEBUG MARKER: == sanity test 215: /proc/sys/lnet exists and has proper content - bugs 18102, 21079, 21517 == 00:59:39 (1414396779) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 216: check lockless direct write works and updates file size and kms correctly == 00:59:41 \(1414396781\) Lustre: DEBUG MARKER: == sanity test 216: check lockless direct write works and updates file size and kms correctly == 00:59:41 (1414396781) Lustre: DEBUG MARKER: /usr/sbin/lctl get_param ldlm.namespaces.filter-*.max_nolock_bytes | while read s; do echo ost1 $s; done Lustre: DEBUG MARKER: /usr/sbin/lctl get_param ldlm.namespaces.filter-*.max_nolock_bytes | while read s; do echo ost2 $s; done Lustre: DEBUG MARKER: /usr/sbin/lctl get_param ldlm.namespaces.filter-*.contended_locks | while read s; do echo ost1 $s; done Lustre: DEBUG MARKER: /usr/sbin/lctl get_param ldlm.namespaces.filter-*.contended_locks | while read s; do echo ost2 $s; done Lustre: DEBUG MARKER: /usr/sbin/lctl get_param ldlm.namespaces.filter-*.contention_seconds | while read s; do echo ost1 $s; done Lustre: DEBUG MARKER: /usr/sbin/lctl get_param ldlm.namespaces.filter-*.contention_seconds | while read s; do echo ost2 $s; done Lustre: DEBUG MARKER: lctl set_param -n ldlm.namespaces.filter-*.max_nolock_bytes 2000000; lctl set_param -n ldlm.namespaces.filter-*.contended_locks 0; lctl set_param -n ldlm.namespaces.filter-*.contention_seconds 60 Lustre: DEBUG MARKER: lctl set_param -n ldlm.namespaces.filter-*.max_nolock_bytes 0; lctl set_param -n ldlm.namespaces.filter-*.contended_locks 32; lctl set_param -n ldlm.namespaces.filter-*.contention_seconds 0 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0000_UUID.max_nolock_bytes 0 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0001_UUID.max_nolock_bytes 0 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0000_UUID.max_nolock_bytes 0 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0001_UUID.max_nolock_bytes 0 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0000_UUID.contended_locks 32 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0001_UUID.contended_locks 32 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0000_UUID.contended_locks 32 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0001_UUID.contended_locks 32 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0000_UUID.contention_seconds 2 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0001_UUID.contention_seconds 2 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0000_UUID.contention_seconds 2 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n ldlm.namespaces.filter-lustre-OST0001_UUID.contention_seconds 2 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 217: check lctl ping for hostnames with hiphen \(\'-\'\) == 00:59:48 \(1414396788\) Lustre: DEBUG MARKER: == sanity test 217: check lctl ping for hostnames with hiphen ('-') == 00:59:48 (1414396788) Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep tcp | cut -f 1 -d '@' Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 218: parallel read and truncate should not deadlock ========================= 00:59:50 \(1414396790\) Lustre: DEBUG MARKER: == sanity test 218: parallel read and truncate should not deadlock ========================= 00:59:50 (1414396790) Lustre: DEBUG MARKER: /usr/sbin/lctl mark creating a 10 Mb file Lustre: DEBUG MARKER: creating a 10 Mb file Lustre: DEBUG MARKER: /usr/sbin/lctl mark starting reads Lustre: DEBUG MARKER: starting reads Lustre: DEBUG MARKER: /usr/sbin/lctl mark truncating the file Lustre: DEBUG MARKER: truncating the file Lustre: DEBUG MARKER: /usr/sbin/lctl mark killing dd Lustre: DEBUG MARKER: killing dd Lustre: DEBUG MARKER: /usr/sbin/lctl mark removing the temporary file Lustre: DEBUG MARKER: removing the temporary file Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 219: LU-394: Write partial won\'t cause uncontiguous pages vec at LND == 00:59:59 \(1414396799\) Lustre: DEBUG MARKER: == sanity test 219: LU-394: Write partial won't cause uncontiguous pages vec at LND == 00:59:59 (1414396799) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 220: preallocated MDS objects still used if ENOSPC from OST == 01:00:01 \(1414396801\) Lustre: DEBUG MARKER: == sanity test 220: preallocated MDS objects still used if ENOSPC from OST == 01:00:01 (1414396801) Lustre: DEBUG MARKER: lctl set_param fail_val=-1 Lustre: DEBUG MARKER: lctl set_param fail_loc=0x229 Lustre: *** cfs_fail_loc=229, val=1*** Lustre: Skipped 11 previous similar messages Lustre: DEBUG MARKER: lctl set_param fail_val=0 Lustre: DEBUG MARKER: lctl set_param fail_loc=0 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 221: make sure fault and truncate race to not cause OOM == 01:00:33 \(1414396833\) Lustre: DEBUG MARKER: == sanity test 221: make sure fault and truncate race to not cause OOM == 01:00:33 (1414396833) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 222a: AGL for ls should not trigger CLIO lock failure ================== 01:04:04 \(1414397044\) Lustre: DEBUG MARKER: == sanity test 222a: AGL for ls should not trigger CLIO lock failure ================== 01:04:04 (1414397044) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 222b: AGL for rmdir should not trigger CLIO lock failure =============== 01:04:06 \(1414397046\) Lustre: DEBUG MARKER: == sanity test 222b: AGL for rmdir should not trigger CLIO lock failure =============== 01:04:06 (1414397046) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 223: osc reenqueue if without AGL lock granted ========================= 01:04:08 \(1414397048\) Lustre: DEBUG MARKER: == sanity test 223: osc reenqueue if without AGL lock granted ========================= 01:04:08 (1414397048) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 224a: Don\'t panic on bulk IO failure == 01:04:09 \(1414397049\) Lustre: DEBUG MARKER: == sanity test 224a: Don't panic on bulk IO failure == 01:04:09 (1414397049) Lustre: lustre-OST0000: Client a6fd6822-5c38-9a8a-92c8-53193c3da88f (at 10.100.4.127@tcp) reconnecting Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 224b: Don\'t panic on bulk IO failure == 01:04:12 \(1414397052\) Lustre: DEBUG MARKER: == sanity test 224b: Don't panic on bulk IO failure == 01:04:12 (1414397052) Lustre: lustre-OST0001: Client a6fd6822-5c38-9a8a-92c8-53193c3da88f (at 10.100.4.127@tcp) reconnecting Lustre: lustre-OST0001: Client a6fd6822-5c38-9a8a-92c8-53193c3da88f (at 10.100.4.127@tcp) refused reconnection, still busy with 1 active RPCs LustreError: 21012:0:(ldlm_lib.c:2707:target_bulk_io()) @@@ Reconnect on bulk PUT req@ffff8800722d0400 x1483094174819740/t0(0) o3->a6fd6822-5c38-9a8a-92c8-53193c3da88f@10.100.4.127@tcp:0/0 lens 488/432 e 0 to 0 dl 1414397064 ref 1 fl Interpret:/0/0 rc 0/0 Lustre: lustre-OST0001: Bulk IO read error with a6fd6822-5c38-9a8a-92c8-53193c3da88f (at 10.100.4.127@tcp), client will retry: rc -110 Lustre: lustre-OST0001: Client a6fd6822-5c38-9a8a-92c8-53193c3da88f (at 10.100.4.127@tcp) reconnecting Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 225a: Metadata survey sanity with zero-stripe == 01:04:20 \(1414397060\) Lustre: DEBUG MARKER: == sanity test 225a: Metadata survey sanity with zero-stripe == 01:04:20 (1414397060) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 225b: Metadata survey sanity with stripe_count = 1 == 01:04:30 \(1414397070\) Lustre: DEBUG MARKER: == sanity test 225b: Metadata survey sanity with stripe_count = 1 == 01:04:30 (1414397070) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 226a: call path2fid and fid2path on files of all type == 01:04:40 \(1414397080\) Lustre: DEBUG MARKER: == sanity test 226a: call path2fid and fid2path on files of all type == 01:04:40 (1414397080) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 226b: call path2fid and fid2path on files of all type under remote dir == 01:04:41 \(1414397081\) Lustre: DEBUG MARKER: == sanity test 226b: call path2fid and fid2path on files of all type under remote dir == 01:04:41 (1414397081) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_226b needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_226b needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 227: running truncated executable does not cause OOM == 01:04:43 \(1414397083\) Lustre: DEBUG MARKER: == sanity test 227: running truncated executable does not cause OOM == 01:04:43 (1414397083) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 228a: try to reuse idle OI blocks == 01:04:45 \(1414397085\) Lustre: DEBUG MARKER: == sanity test 228a: try to reuse idle OI blocks == 01:04:45 (1414397085) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_228a non-ldiskfs backend Lustre: DEBUG MARKER: SKIP: sanity test_228a non-ldiskfs backend Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 228b: idle OI blocks can be reused after MDT restart == 01:04:47 \(1414397087\) Lustre: DEBUG MARKER: == sanity test 228b: idle OI blocks can be reused after MDT restart == 01:04:47 (1414397087) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_228b non-ldiskfs backend Lustre: DEBUG MARKER: SKIP: sanity test_228b non-ldiskfs backend Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 228c: NOT shrink the last entry in OI index node to recycle idle leaf == 01:04:48 \(1414397088\) Lustre: DEBUG MARKER: == sanity test 228c: NOT shrink the last entry in OI index node to recycle idle leaf == 01:04:48 (1414397088) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_228c non-ldiskfs backend Lustre: DEBUG MARKER: SKIP: sanity test_228c non-ldiskfs backend Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 229: getstripe\/stat\/rm\/attr changes work on released files == 01:04:50 \(1414397090\) Lustre: DEBUG MARKER: == sanity test 229: getstripe/stat/rm/attr changes work on released files == 01:04:50 (1414397090) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 230a: Create remote directory and files under the remote directory == 01:04:52 \(1414397092\) Lustre: DEBUG MARKER: == sanity test 230a: Create remote directory and files under the remote directory == 01:04:52 (1414397092) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_230a needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_230a needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 230b: nested remote directory should be failed == 01:04:54 \(1414397094\) Lustre: DEBUG MARKER: == sanity test 230b: nested remote directory should be failed == 01:04:54 (1414397094) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_230b needs \>= 2 MDTs Lustre: DEBUG MARKER: SKIP: sanity test_230b needs >= 2 MDTs Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 231a: checking that reading\/writing of BRW RPC size results in one RPC == 01:04:56 \(1414397096\) Lustre: DEBUG MARKER: == sanity test 231a: checking that reading/writing of BRW RPC size results in one RPC == 01:04:56 (1414397096) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 231b: must not assert on fully utilized OST request buffer == 01:04:58 \(1414397098\) Lustre: DEBUG MARKER: == sanity test 231b: must not assert on fully utilized OST request buffer == 01:04:58 (1414397098) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 232: failed lock should not block umount == 01:05:10 \(1414397110\) Lustre: DEBUG MARKER: == sanity test 232: failed lock should not block umount == 01:05:10 (1414397110) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 233a: checking that OBF of the FS root succeeds == 01:05:11 \(1414397111\) Lustre: DEBUG MARKER: == sanity test 233a: checking that OBF of the FS root succeeds == 01:05:11 (1414397111) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 233b: checking that OBF of the FS .lustre succeeds == 01:05:13 \(1414397113\) Lustre: DEBUG MARKER: == sanity test 233b: checking that OBF of the FS .lustre succeeds == 01:05:13 (1414397113) Lustre: DEBUG MARKER: /usr/sbin/lctl mark SKIP: sanity test_233b Need MDS version at least 2.5.90 Lustre: DEBUG MARKER: SKIP: sanity test_233b Need MDS version at least 2.5.90 Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 234: xattr cache should not crash on ENOMEM == 01:05:15 \(1414397115\) Lustre: DEBUG MARKER: == sanity test 234: xattr cache should not crash on ENOMEM == 01:05:15 (1414397115) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 235: LU-1715: flock deadlock detection does not work properly == 01:05:17 \(1414397117\) Lustre: DEBUG MARKER: == sanity test 235: LU-1715: flock deadlock detection does not work properly == 01:05:17 (1414397117) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 236: Layout swap on open unlinked file == 01:05:20 \(1414397120\) Lustre: DEBUG MARKER: == sanity test 236: Layout swap on open unlinked file == 01:05:20 (1414397120) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 238: Verify linkea consistency == 01:05:25 \(1414397125\) Lustre: DEBUG MARKER: == sanity test 238: Verify linkea consistency == 01:05:25 (1414397125) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test 900: umount should not race with any mgc requeue thread == 01:05:27 \(1414397127\) Lustre: DEBUG MARKER: == sanity test 900: umount should not race with any mgc requeue thread == 01:05:27 (1414397127) LustreError: 11-0: lustre-MDT0000-lwp-OST0000: Communicating with 10.100.4.133@tcp, operation obd_ping failed with -107. Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 10.100.4.133@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: grep -c /mnt/ost1' ' /proc/mounts Lustre: DEBUG MARKER: umount -d -f /mnt/ost1 Lustre: server umount lustre-OST0000 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' Lustre: DEBUG MARKER: ! zpool list -H lustre-ost1 >/dev/null 2>&1 || grep -q ^lustre-ost1/ /proc/mounts || zpool export lustre-ost1 Lustre: DEBUG MARKER: grep -c /mnt/ost2' ' /proc/mounts Lustre: DEBUG MARKER: umount -d -f /mnt/ost2 Lustre: 1679:0:(client.c:1918:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1414397146/real 1414397146] req@ffff88006e9d2000 x1483094239586724/t0(0) o251->MGC10.100.4.133@tcp@10.100.4.133@tcp:26/25 lens 224/224 e 0 to 1 dl 1414397152 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 Lustre: 1679:0:(client.c:1918:ptlrpc_expire_one_request()) Skipped 1 previous similar message Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && lctl dl | grep ' ST ' Lustre: DEBUG MARKER: ! zpool list -H lustre-ost2 >/dev/null 2>&1 || grep -q ^lustre-ost2/ /proc/mounts || zpool export lustre-ost2 Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost1' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost1' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost2' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost2' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: mkdir -p /mnt/ost1 Lustre: DEBUG MARKER: zpool list -H lustre-ost1 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost1 Lustre: DEBUG MARKER: mkdir -p /mnt/ost1; mount -t lustre lustre-ost1/ost1 /mnt/ost1 Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null Lustre: DEBUG MARKER: mkdir -p /mnt/ost2 LustreError: 137-5: lustre-OST0001_UUID: not available for connect from 10.100.4.133@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: lustre-OST0000: deleting orphan objects from 0x0:31051 to 0x0:32577 Lustre: DEBUG MARKER: zpool list -H lustre-ost2 >/dev/null 2>&1 || zpool import -f -o cachefile=none -d /dev lustre-ost2 Lustre: DEBUG MARKER: mkdir -p /mnt/ost2; mount -t lustre lustre-ost2/ost2 /mnt/ost2 Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost2/ost2 2>/dev/null Lustre: lustre-OST0001: deleting orphan objects from 0x0:25945 to 0x0:26497 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity test complete, duration 8282 sec == 01:06:50 \(1414397210\) Lustre: DEBUG MARKER: == sanity test complete, duration 8282 sec == 01:06:50 (1414397210) Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: sanity-benchmark ============----- Mon Oct 27 01:07:17 PDT 2014 Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-benchmark ============----- Mon Oct 27 01:07:17 PDT 2014 Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: Lustre: DEBUG MARKER: excepting tests: Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost1' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost1' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: running=$(grep -c /mnt/ost2' ' /proc/mounts); mpts=$(mount | grep -c /mnt/ost2' '); if [ $running -ne $mpts ]; then echo $(hostname) env are INSANE!; exit 1; fi Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost1/ost1 2>/dev/null Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-ost2/ost2 2>/dev/null Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity-benchmark test dbench: dbench == 01:07:32 \(1414397252\) Lustre: DEBUG MARKER: == sanity-benchmark test dbench: dbench == 01:07:32 (1414397252) LNet: Service thread pid 4106 completed after 103.55s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). LNet: Service thread pid 4055 completed after 108.75s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). LNet: Skipped 7 previous similar messages LNet: Service thread pid 3487 completed after 112.21s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity-benchmark test bonnie: bonnie++ == 01:31:46 \(1414398706\) Lustre: DEBUG MARKER: == sanity-benchmark test bonnie: bonnie++ == 01:31:46 (1414398706) Lustre: DEBUG MARKER: /usr/sbin/lctl mark min OST has 64744960kB available, using 3845048kB file size Lustre: DEBUG MARKER: min OST has 64744960kB available, using 3845048kB file size Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity-benchmark test iozone: iozone == 01:52:04 \(1414399924\) Lustre: DEBUG MARKER: == sanity-benchmark test iozone: iozone == 01:52:04 (1414399924) Lustre: DEBUG MARKER: /usr/sbin/lctl mark min OST has 65008384kB available, using 3845048kB file size Lustre: DEBUG MARKER: min OST has 65008384kB available, using 3845048kB file size LNet: Service thread pid 4122 completed after 49.15s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). LNet: Skipped 5 previous similar messages LNet: Service thread pid 3345 completed after 46.03s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). LNet: Skipped 3 previous similar messages LNet: Service thread pid 4101 completed after 47.23s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity-benchmark test fsx: fsx == 06:21:29 \(1414416089\) Lustre: DEBUG MARKER: == sanity-benchmark test fsx: fsx == 06:21:29 (1414416089) Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity-benchmark test pios_ssf: pios shared single file == 06:38:28 \(1414417108\) Lustre: DEBUG MARKER: == sanity-benchmark test pios_ssf: pios shared single file == 06:38:28 (1414417108) Lustre: DEBUG MARKER: /usr/sbin/lctl mark \/usr\/bin\/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M -p \/mnt\/lustre\/dpios_ssf.sanity-benchmark Lustre: DEBUG MARKER: /usr/bin/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M -p /mnt/lustre/dpios_ssf.sanity-benchmark Lustre: DEBUG MARKER: /usr/sbin/lctl mark \/usr\/bin\/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M --verify -p \/mnt\/lustre\/dpios_ssf.sanity-benchmark Lustre: DEBUG MARKER: /usr/bin/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M --verify -p /mnt/lustre/dpios_ssf.sanity-benchmark Lustre: DEBUG MARKER: lctl set_param -n fail_loc=0 2>/dev/null || true Lustre: DEBUG MARKER: rc=$([ -f /proc/sys/lnet/catastrophe ] && echo $(< /proc/sys/lnet/catastrophe) || echo 0); if [ $rc -ne 0 ]; then echo $(hostname): $rc; fi exit $rc Lustre: DEBUG MARKER: /usr/sbin/lctl mark == sanity-benchmark test pios_fpp: pios file per process == 07:35:27 \(1414420527\) Lustre: DEBUG MARKER: == sanity-benchmark test pios_fpp: pios file per process == 07:35:27 (1414420527) Lustre: DEBUG MARKER: /usr/sbin/lctl mark \/usr\/bin\/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M -L fpp -p \/mnt\/lustre\/dpios_fpp.sanity-benchmark Lustre: DEBUG MARKER: /usr/bin/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M -L fpp -p /mnt/lustre/dpios_fpp.sanity-benchmark LNet: Service thread pid 3487 completed after 72.76s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). Lustre: DEBUG MARKER: /usr/sbin/lctl mark \/usr\/bin\/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M -L fpp --verify -p \/mnt\/lustre\/dpios_fpp.sanity-benchmark Lustre: DEBUG MARKER: /usr/bin/pios -t 1,8,40 -n 1024 -c 1M -s 8M -o 16M -L fpp --verify -p /mnt/lustre/dpios_fpp.sanity-benchmark ntpd invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0 ntpd cpuset=/ mems_allowed=0 Pid: 7059, comm: ntpd Tainted: P --------------- 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 #1 Call Trace: [] ? cpuset_print_task_mems_allowed+0x91/0xb0 [] ? dump_header+0x90/0x1b0 [] ? check_panic_on_oom+0x4e/0x80 [] ? out_of_memory+0x1bb/0x3c0 [] ? __alloc_pages_nodemask+0x89f/0x8d0 [] ? alloc_pages_vma+0x9a/0x150 [] ? read_swap_cache_async+0xf2/0x160 [] ? valid_swaphandles+0x69/0x150 [] ? swapin_readahead+0x87/0xc0 [] ? handle_pte_fault+0x6dd/0xb00 [] ? perf_event_task_sched_out+0x33/0x70 [] ? handle_mm_fault+0x22a/0x300 [] ? __do_page_fault+0x138/0x480 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? do_page_fault+0x3e/0xa0 [] ? page_fault+0x25/0x30 [] ? copy_user_generic_unrolled+0x86/0xb0 [] ? copy_user_generic+0xe/0x20 [] ? set_fd_set+0x49/0x60 [] ? core_sys_select+0x1bc/0x2c0 [] ? __do_page_fault+0x1ec/0x480 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] ? sys_select+0x47/0x110 [] ? system_call_fastpath+0x16/0x1b Mem-Info: Node 0 DMA per-cpu: CPU 0: hi: 0, btch: 1 usd: 0 Node 0 DMA32 per-cpu: CPU 0: hi: 186, btch: 31 usd: 173 active_anon:0 inactive_anon:0 isolated_anon:0 active_file:11 inactive_file:0 isolated_file:0 unevictable:0 dirty:0 writeback:0 unstable:0 free:12689 slab_reclaimable:1535 slab_unreclaimable:12267 mapped:11 shmem:0 pagetables:1007 bounce:0 Node 0 DMA free:8352kB min:332kB low:412kB high:496kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15348kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:4kB slab_unreclaimable:20kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes lowmem_reserve[]: 0 2004 2004 2004 Node 0 DMA32 free:42404kB min:44720kB low:55900kB high:67080kB active_anon:0kB inactive_anon:0kB active_file:44kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:2052308kB mlocked:0kB dirty:0kB writeback:0kB mapped:44kB shmem:0kB slab_reclaimable:6136kB slab_unreclaimable:49048kB kernel_stack:3440kB pagetables:4028kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:91 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0 Node 0 DMA: 2*4kB 1*8kB 1*16kB 2*32kB 1*64kB 2*128kB 1*256kB 1*512kB 1*1024kB 3*2048kB 0*4096kB = 8352kB Node 0 DMA32: 3625*4kB 1448*8kB 370*16kB 95*32kB 17*64kB 3*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 1*4096kB = 42404kB 25 total pagecache pages 0 pages in swap cache Swap cache stats: add 5091, delete 5091, find 30/52 Free swap = 4109104kB Total swap = 4128764kB 524284 pages RAM 43654 pages reserved 54 pages shared 460966 pages non-shared [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name [ 352] 0 352 2663 0 0 -17 -1000 udevd [ 1046] 0 1046 2280 1 0 0 0 dhclient [ 1098] 0 1098 6910 1 0 -17 -1000 auditd [ 1114] 0 1114 63855 1 0 0 0 rsyslogd [ 1154] 32 1154 4744 1 0 0 0 rpcbind [ 1166] 0 1166 49883 1 0 0 0 sssd [ 1167] 0 1167 64216 1 0 0 0 sssd_be [ 1168] 0 1168 50374 1 0 0 0 sssd_nss [ 1169] 0 1169 47950 1 0 0 0 sssd_pam [ 1170] 0 1170 47399 1 0 0 0 sssd_ssh [ 1171] 0 1171 52529 1 0 0 0 sssd_pac [ 1188] 29 1188 6357 1 0 0 0 rpc.statd [ 6805] 81 6805 5871 1 0 0 0 dbus-daemon [ 6843] 0 6843 1020 0 0 0 0 acpid [ 6852] 68 6852 9924 1 0 0 0 hald [ 6853] 0 6853 5081 1 0 0 0 hald-runner [ 6885] 0 6885 5611 1 0 0 0 hald-addon-inpu [ 6896] 68 6896 4483 1 0 0 0 hald-addon-acpi [ 6916] 0 6916 151443 1 0 0 0 automount [ 6957] 0 6957 26827 0 0 0 0 rpc.rquotad [ 6961] 0 6961 5414 0 0 0 0 rpc.mountd [ 6997] 0 6997 5773 1 0 0 0 rpc.idmapd [ 7028] 496 7028 56785 1 0 0 0 munged [ 7043] 0 7043 16656 0 0 -17 -1000 sshd [ 7051] 0 7051 5545 1 0 0 0 xinetd [ 7059] 38 7059 8205 1 0 0 0 ntpd [ 7135] 0 7135 20846 1 0 0 0 master [ 7144] 89 7144 20909 1 0 0 0 qmgr [ 7158] 0 7158 29324 1 0 0 0 crond [ 7169] 0 7169 5385 0 0 0 0 atd [ 7197] 0 7197 15585 1 0 0 0 certmonger [ 7209] 0 7209 1020 1 0 0 0 agetty [ 7210] 0 7210 1016 1 0 0 0 mingetty [ 7212] 0 7212 1016 1 0 0 0 mingetty [ 7214] 0 7214 1016 1 0 0 0 mingetty [ 7216] 0 7216 1016 1 0 0 0 mingetty [ 7218] 0 7218 2702 0 0 -17 -1000 udevd [ 7219] 0 7219 2702 0 0 -17 -1000 udevd [ 7220] 0 7220 1016 1 0 0 0 mingetty [ 7222] 0 7222 1016 1 0 0 0 mingetty [29296] 89 29296 20866 1 0 0 0 pickup Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled Pid: 7059, comm: ntpd Tainted: P --------------- 2.6.32-431.29.2.el6_lustre.g9835a2a.x86_64 #1 Call Trace: [] ? panic+0xa7/0x16f [] ? dump_header+0x191/0x1b0 [] ? check_panic_on_oom+0x7c/0x80 [] ? out_of_memory+0x1bb/0x3c0 [] ? __alloc_pages_nodemask+0x89f/0x8d0 [] ? alloc_pages_vma+0x9a/0x150 [] ? read_swap_cache_async+0xf2/0x160 [] ? valid_swaphandles+0x69/0x150 [] ? swapin_readahead+0x87/0xc0 [] ? handle_pte_fault+0x6dd/0xb00 [] ? perf_event_task_sched_out+0x33/0x70 [] ? handle_mm_fault+0x22a/0x300 [] ? __do_page_fault+0x138/0x480 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? pollwake+0x0/0x60 [] ? do_page_fault+0x3e/0xa0 [] ? page_fault+0x25/0x30 [] ? copy_user_generic_unrolled+0x86/0xb0 [] ? copy_user_generic+0xe/0x20 [] ? set_fd_set+0x49/0x60 [] ? core_sys_select+0x1bc/0x2c0 [] ? __do_page_fault+0x1ec/0x480 [] ? pvclock_clocksource_read+0x58/0xd0 [] ? kvm_clock_read+0x1c/0x20 [] ? kvm_clock_get_cycles+0x9/0x10 [] ? ktime_get_ts+0xb1/0xf0 [] ? sys_select+0x47/0x110 [] ? system_call_fastpath+0x16/0x1b Console [eagle-44vm1] joined by on pts/0 at 10-27 15:47. Console [eagle-44vm1] departed by on pts/0 at 10-27 15:47.