[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7.x86_64 root=UUID=6b69eeb5-d65e-40f4-bc47-cc12ed89dc26 ro crashkernel=auto console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009f7ff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009f800-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007fff9fff] usable [ 0.000000] BIOS-e820: [mem 0x000000007fffa000-0x000000007fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.4 present. [ 0.000000] DMI: Red Hat KVM, BIOS 0.5.1 01/01/2011 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x7fffa max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 000080000000 mask 3FFF80000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] found SMP MP-table at [mem 0x000f72e0-0x000f72ef] mapped at [ffffffffff2002e0] [ 0.000000] Base memory trampoline at [ffffa12480099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x72052000, 0x72052fff] PGTABLE [ 0.000000] BRK [0x72053000, 0x72053fff] PGTABLE [ 0.000000] BRK [0x72054000, 0x72054fff] PGTABLE [ 0.000000] BRK [0x72055000, 0x72055fff] PGTABLE [ 0.000000] BRK [0x72056000, 0x72056fff] PGTABLE [ 0.000000] BRK [0x72057000, 0x72057fff] PGTABLE [ 0.000000] RAMDISK: [mem 0x35cca000-0x36e5cfff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f7110 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 000000007ffffb04 00030 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 000000007ffff177 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 000000007fffe040 01137 (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 000000007fffe000 00040 [ 0.000000] ACPI: SSDT 000000007ffff1eb 00899 (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001) [ 0.000000] ACPI: APIC 000000007ffffa84 00080 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000007fff9fff] [ 0.000000] NODE_DATA(0) allocated [mem 0x7ffd3000-0x7fff9fff] [ 0.000000] Reserving 161MB of memory at 688MB for crashkernel (System RAM: 2047MB) [ 0.000000] kvm-clock: cpu 0, msr 0:7ff82001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 1098455476996 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0x7fff9fff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x7fff9fff] [ 0.000000] On node 0 totalpages: 524184 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 8128 pages used for memmap [ 0.000000] DMA32 zone: 520186 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] smpboot: Allowing 2 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] e820: [mem 0x80000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 38 pages/cpu @ffffa124ffc00000 s118784 r8192 d28672 u1048576 [ 0.000000] pcpu-alloc: s118784 r8192 d28672 u1048576 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 7fc1c040 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 515971 [ 0.000000] Policy zone: DMA32 [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.el7.x86_64 root=UUID=6b69eeb5-d65e-40f4-bc47-cc12ed89dc26 ro crashkernel=auto console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 1861172k/2097128k available (7664k kernel code, 392k absent, 235564k reserved, 6055k data, 1876k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 [ 0.000000] x86/pti: Unmapping kernel while in userspace [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=2. [ 0.000000] NR_IRQS:327936 nr_irqs:440 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 8388608 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] tsc: Detected 2593.748 MHz processor [ 0.104278] Calibrating delay loop (skipped) preset value.. 5187.49 BogoMIPS (lpj=2593748) [ 0.105245] pid_max: default: 32768 minimum: 301 [ 0.105803] Security Framework initialized [ 0.106289] SELinux: Initializing. [ 0.106722] SELinux: Starting in permissive mode [ 0.106723] Yama: becoming mindful. [ 0.107324] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.109238] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.110559] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes) [ 0.111305] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes) [ 0.112338] Initializing cgroup subsys memory [ 0.112859] Initializing cgroup subsys devices [ 0.113375] Initializing cgroup subsys freezer [ 0.113889] Initializing cgroup subsys net_cls [ 0.114408] Initializing cgroup subsys blkio [ 0.114898] Initializing cgroup subsys perf_event [ 0.115437] Initializing cgroup subsys hugetlb [ 0.115947] Initializing cgroup subsys pids [ 0.116460] Initializing cgroup subsys net_prio [ 0.117046] mce: CPU supports 10 MCE banks [ 0.117586] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.118185] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.118788] tlb_flushall_shift: 6 [ 0.119182] Speculative Store Bypass: Vulnerable [ 0.119715] FEATURE SPEC_CTRL Not Present [ 0.120178] FEATURE IBPB_SUPPORT Not Present [ 0.121131] Spectre V2 : Vulnerable: Retpoline without IBPB [ 0.122216] Freeing SMP alternatives: 28k freed [ 0.130044] ACPI: Core revision 20130517 [ 0.131253] ACPI: All ACPI Tables successfully acquired [ 0.131978] ftrace: allocating 29185 entries in 115 pages [ 0.176385] Enabling x2apic [ 0.176750] Enabled x2apic [ 0.177318] Switched APIC routing to physical x2apic. [ 0.178945] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.179740] smpboot: CPU0: Intel Xeon E312xx (Sandy Bridge) (fam: 06, model: 2a, stepping: 01) [ 0.180989] TSC deadline timer enabled [ 0.181000] Performance Events: unsupported p6 CPU model 42 no PMU driver, software events only. [ 0.182216] KVM setup paravirtual spinlock [ 0.184566] smpboot: Booting Node 0, Processors #1 OK [ 0.185530] kvm-clock: cpu 1, msr 0:7ff82041, secondary cpu clock [ 0.206452] Brought up 2 CPUs [ 0.206457] KVM setup async PF for cpu 1 [ 0.206461] kvm-stealtime: cpu 1, msr 7fd1c040 [ 0.207745] smpboot: Max logical packages: 2 [ 0.208219] smpboot: Total of 2 processors activated (10374.99 BogoMIPS) [ 0.209643] devtmpfs: initialized [ 0.212100] EVM: security.selinux [ 0.212527] EVM: security.ima [ 0.212879] EVM: security.capability [ 0.214669] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.215440] pinctrl core: initialized pinctrl subsystem [ 0.216084] RTC time: 0:29:04, date: 12/14/18 [ 0.216687] NET: Registered protocol family 16 [ 0.217485] ACPI: bus type PCI registered [ 0.217943] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.218745] PCI: Using configuration type 1 for base access [ 0.223936] ACPI: Added _OSI(Module Device) [ 0.224452] ACPI: Added _OSI(Processor Device) [ 0.224939] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.225466] ACPI: Added _OSI(Processor Aggregator Device) [ 0.226047] ACPI: Added _OSI(Linux-Dell-Video) [ 0.227042] ACPI: EC: Look up EC in DSDT [ 0.228382] ACPI: Interpreter enabled [ 0.228835] ACPI: (supports S0 S5) [ 0.229225] ACPI: Using IOAPIC for interrupt routing [ 0.229776] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.231029] ACPI: Enabled 16 GPEs in block 00 to 0F [ 0.234337] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.235037] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.235776] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.236507] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.238051] acpiphp: Slot [3] registered [ 0.238537] acpiphp: Slot [4] registered [ 0.239024] acpiphp: Slot [5] registered [ 0.239524] acpiphp: Slot [6] registered [ 0.240005] acpiphp: Slot [7] registered [ 0.240476] acpiphp: Slot [8] registered [ 0.240937] acpiphp: Slot [9] registered [ 0.241428] acpiphp: Slot [10] registered [ 0.241916] acpiphp: Slot [11] registered [ 0.242407] acpiphp: Slot [12] registered [ 0.242886] acpiphp: Slot [13] registered [ 0.243370] acpiphp: Slot [14] registered [ 0.243879] acpiphp: Slot [15] registered [ 0.244369] acpiphp: Slot [16] registered [ 0.244854] acpiphp: Slot [17] registered [ 0.245362] acpiphp: Slot [18] registered [ 0.245841] acpiphp: Slot [19] registered [ 0.246350] acpiphp: Slot [20] registered [ 0.246825] acpiphp: Slot [21] registered [ 0.247325] acpiphp: Slot [22] registered [ 0.247804] acpiphp: Slot [23] registered [ 0.248294] acpiphp: Slot [24] registered [ 0.248787] acpiphp: Slot [25] registered [ 0.249272] acpiphp: Slot [26] registered [ 0.249758] acpiphp: Slot [27] registered [ 0.250243] acpiphp: Slot [28] registered [ 0.250720] acpiphp: Slot [29] registered [ 0.251215] acpiphp: Slot [30] registered [ 0.251703] acpiphp: Slot [31] registered [ 0.252164] PCI host bridge to bus 0000:00 [ 0.252631] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.253372] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.254175] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.254985] pci_bus 0000:00: root bus resource [mem 0x80000000-0xfebfffff window] [ 0.255797] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.256427] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.256766] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.257260] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.263231] pci 0000:00:01.1: reg 0x20: [io 0xc180-0xc18f] [ 0.265610] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.266394] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.267094] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.267891] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.268744] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 [ 0.274661] pci 0000:00:01.2: reg 0x20: [io 0xc140-0xc15f] [ 0.277183] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.277525] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.278312] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.279288] pci 0000:00:03.0: [10ec:8139] type 00 class 0x020000 [ 0.281589] pci 0000:00:03.0: reg 0x10: [io 0xc000-0xc0ff] [ 0.283863] pci 0000:00:03.0: reg 0x14: [mem 0xfebc0000-0xfebc00ff] [ 0.295295] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.295531] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 [ 0.297874] pci 0000:00:04.0: reg 0x10: [io 0xc100-0xc13f] [ 0.300174] pci 0000:00:04.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.311952] pci 0000:00:05.0: [1af4:1002] type 00 class 0x00ff00 [ 0.313159] pci 0000:00:05.0: reg 0x10: [io 0xc160-0xc17f] [ 0.320743] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 0.321679] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 0.322590] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 0.323501] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 0.324375] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 0.325340] vgaarb: loaded [ 0.325774] SCSI subsystem initialized [ 0.326243] ACPI: bus type USB registered [ 0.326722] usbcore: registered new interface driver usbfs [ 0.327320] usbcore: registered new interface driver hub [ 0.327917] usbcore: registered new device driver usb [ 0.328608] EDAC MC: Ver: 3.0.0 [ 0.329249] PCI: Using ACPI for IRQ routing [ 0.329740] PCI: pci_cache_line_size set to 64 bytes [ 0.329849] e820: reserve RAM buffer [mem 0x0009f800-0x0009ffff] [ 0.329851] e820: reserve RAM buffer [mem 0x7fffa000-0x7fffffff] [ 0.330010] NetLabel: Initializing [ 0.330409] NetLabel: domain hash size = 128 [ 0.330876] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.331470] NetLabel: unlabeled traffic allowed by default [ 0.332179] amd_nb: Cannot enumerate AMD northbridges [ 0.332757] Switched to clocksource kvm-clock [ 0.341812] pnp: PnP ACPI init [ 0.342216] ACPI: bus type PNP registered [ 0.342728] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.342798] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active) [ 0.342850] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active) [ 0.342893] pnp 00:03: [dma 2] [ 0.342917] pnp 00:03: Plug and Play ACPI device, IDs PNP0700 (active) [ 0.343015] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.343193] pnp: PnP ACPI: found 5 devices [ 0.343651] ACPI: bus type PNP unregistered [ 0.351709] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.351712] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.351714] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.351716] pci_bus 0000:00: resource 7 [mem 0x80000000-0xfebfffff window] [ 0.351752] NET: Registered protocol family 2 [ 0.352510] TCP established hash table entries: 16384 (order: 5, 131072 bytes) [ 0.353419] TCP bind hash table entries: 16384 (order: 6, 262144 bytes) [ 0.354282] TCP: Hash tables configured (established 16384 bind 16384) [ 0.355076] TCP: reno registered [ 0.355459] UDP hash table entries: 1024 (order: 3, 32768 bytes) [ 0.356135] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes) [ 0.356898] NET: Registered protocol family 1 [ 0.357398] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.358079] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.359018] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.360014] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11 [ 0.361469] PCI: CLS 0 bytes, default 64 [ 0.361533] Unpacking initramfs... [ 0.630721] Freeing initrd memory: 17996k freed [ 0.648220] sha1_ssse3: Using AVX optimized SHA-1 implementation [ 0.649064] sha256_ssse3: Using AVX optimized SHA-256 implementation [ 0.650091] futex hash table entries: 512 (order: 3, 32768 bytes) [ 0.650787] Initialise system trusted keyring [ 0.651295] audit: initializing netlink socket (disabled) [ 0.651912] type=2000 audit(1544747345.237:1): initialized [ 0.674493] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 0.675230] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 0.677668] zpool: loaded [ 0.678024] zbud: loaded [ 0.678600] VFS: Disk quotas dquot_6.5.2 [ 0.679102] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.679998] msgmni has been set to 3670 [ 0.680503] Key type big_key registered [ 0.680950] SELinux: Registering netfilter hooks [ 0.681851] NET: Registered protocol family 38 [ 0.682360] Key type asymmetric registered [ 0.682832] Asymmetric key parser 'x509' registered [ 0.683399] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) [ 0.684262] io scheduler noop registered [ 0.684702] io scheduler deadline registered (default) [ 0.685311] io scheduler cfq registered [ 0.685742] io scheduler mq-deadline registered [ 0.686261] io scheduler kyber registered [ 0.686848] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 0.687463] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 0.688193] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 0.688980] intel_idle: does not run on family 6 model 42 [ 0.689054] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 0.689851] ACPI: Power Button [PWRF] [ 0.690407] GHES: HEST is not enabled! [ 0.690907] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 0.713119] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 0.714287] Non-volatile memory driver v1.3 [ 0.714821] Linux agpgart interface v0.103 [ 0.715420] crash memory driver: version 1.1 [ 0.715988] rdac: device handler registered [ 0.716510] hp_sw: device handler registered [ 0.717006] emc: device handler registered [ 0.717510] alua: device handler registered [ 0.718041] libphy: Fixed MDIO Bus: probed [ 0.718558] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 0.719290] ehci-pci: EHCI PCI platform driver [ 0.719798] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 0.720464] ohci-pci: OHCI PCI platform driver [ 0.720967] uhci_hcd: USB Universal Host Controller Interface driver [ 0.722527] uhci_hcd 0000:00:01.2: UHCI Host Controller [ 0.723176] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 [ 0.723984] uhci_hcd 0000:00:01.2: detected 2 ports [ 0.724596] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c140 [ 0.725316] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001 [ 0.726049] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 0.726850] usb usb1: Product: UHCI Host Controller [ 0.727405] usb usb1: Manufacturer: Linux 3.10.0-957.el7.x86_64 uhci_hcd [ 0.728180] usb usb1: SerialNumber: 0000:00:01.2 [ 0.728842] hub 1-0:1.0: USB hub found [ 0.729289] hub 1-0:1.0: 2 ports detected [ 0.729934] usbcore: registered new interface driver usbserial_generic [ 0.730667] usbserial: USB Serial support registered for generic [ 0.731364] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 0.732885] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 0.733461] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 0.734189] mousedev: PS/2 mouse device common for all mice [ 0.735160] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 0.736792] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input2 [ 0.737796] rtc_cmos 00:00: RTC can wake from S4 [ 0.738576] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 0.739802] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0 [ 0.740554] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram [ 0.741274] cpuidle: using governor menu [ 0.741834] hidraw: raw HID events driver (C) Jiri Kosina [ 0.742580] usbcore: registered new interface driver usbhid [ 0.743199] usbhid: USB HID core driver [ 0.743706] drop_monitor: Initializing network drop monitor service [ 0.744497] TCP: cubic registered [ 0.744896] Initializing XFRM netlink socket [ 0.745503] NET: Registered protocol family 10 [ 0.746277] NET: Registered protocol family 17 [ 0.746847] mpls_gso: MPLS GSO support [ 0.747544] PM: Hibernation image not present or could not be loaded. [ 0.747548] Loading compiled-in X.509 certificates [ 0.748126] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 0.749181] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 0.750766] Loaded X.509 cert 'CentOS Linux kernel signing key: b70dcf0df2d9b7f29159248249fd6fe87b781427' [ 0.751828] registered taskstats version 1 [ 0.755408] Key type trusted registered [ 0.758539] Key type encrypted registered [ 0.759074] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 0.760001] Magic number: 14:12:456 [ 0.760433] mem urandom: hash matches [ 0.760965] rtc_cmos 00:00: setting system clock to 2018-12-14 00:29:05 UTC (1544747345) [ 0.762776] Freeing unused kernel memory: 1876k freed [ 0.763747] Write protecting the kernel read-only data: 12288k [ 0.765599] Freeing unused kernel memory: 516k freed [ 0.767472] Freeing unused kernel memory: 600k freed [ 0.772050] random: systemd: uninitialized urandom read (16 bytes read) [ 0.773476] random: systemd: uninitialized urandom read (16 bytes read) [ 0.774247] random: systemd: uninitialized urandom read (16 bytes read) [ 0.776019] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 0.777929] systemd[1]: Detected virtualization kvm. [ 0.778483] systemd[1]: Detected architecture x86-64. [ 0.779064] systemd[1]: Running in initial RAM disk. [ 0.780618] systemd[1]: Set hostname to . [ 0.812567] random: systemd: uninitialized urandom read (16 bytes read) [ 0.813374] random: systemd: uninitialized urandom read (16 bytes read) [ 0.814148] random: systemd: uninitialized urandom read (16 bytes read) [ 0.814924] random: systemd: uninitialized urandom read (16 bytes read) [ 0.816338] random: systemd: uninitialized urandom read (16 bytes read) [ 0.817260] random: systemd: uninitialized urandom read (16 bytes read) [ 0.818423] random: systemd: uninitialized urandom read (16 bytes read) [ 0.823868] systemd[1]: Reached target Swap. [ 0.825375] systemd[1]: Created slice Root Slice. [ 0.826711] systemd[1]: Listening on Journal Socket. [ 0.828102] systemd[1]: Listening on udev Control Socket. [ 0.829517] systemd[1]: Listening on udev Kernel Socket. [ 0.830990] systemd[1]: Created slice System Slice. [ 0.832908] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 0.835412] systemd[1]: Starting Setup Virtual Console... [ 0.837509] systemd[1]: Starting dracut cmdline hook... [ 0.839395] systemd[1]: Starting Journal Service... [ 0.840606] systemd[1]: Reached target Local File Systems. [ 0.842905] systemd[1]: Starting Apply Kernel Variables... [ 0.844257] systemd[1]: Reached target Timers. [ 0.846311] systemd[1]: Reached target Slices. [ 0.847561] systemd[1]: Reached target Sockets. [ 0.851046] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 0.854823] systemd[1]: Started Apply Kernel Variables. [ 0.857121] systemd[1]: Starting Create Static Device Nodes in /dev... [ 0.862454] systemd[1]: Started Journal Service. [ 0.982903] random: fast init done [ 1.253600] 8139cp: 8139cp: 10/100 PCI Ethernet driver v1.3 (Mar 22, 2004) [ 1.254706] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10 [ 1.269321] 8139cp 0000:00:03.0 eth0: RTL-8139C+ at 0xffffbe91c042c000, 52:54:00:16:6a:e7, IRQ 10 [ 1.270515] virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driver [ 1.272965] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10 [ 1.273621] virtio-pci 0000:00:05.0: virtio_pci: leaving for legacy driver [ 1.280458] libata version 3.00 loaded. [ 1.287139] ata_piix 0000:00:01.1: version 2.13 [ 1.292054] 8139too: 8139too Fast Ethernet driver 0.9.28 [ 1.296718] scsi host0: ata_piix [ 1.302083] scsi host1: ata_piix [ 1.302527] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc180 irq 14 [ 1.303280] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc188 irq 15 [ 1.347316] FDC 0 is a S82078B [ 1.570651] virtio-pci 0000:00:04.0: irq 24 for MSI/MSI-X [ 1.570673] virtio-pci 0000:00:04.0: irq 25 for MSI/MSI-X [ 1.571918] virtio_blk virtio0: [vda] 251658240 512-byte logical blocks (128 GB/120 GiB) [ 1.578268] vda: vda1 vda2 [ 1.647802] tsc: Refined TSC clocksource calibration: 2593.623 MHz [ 6.704184] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null) [ 6.981037] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). [ 7.341718] SELinux: Disabled at runtime. [ 7.342360] SELinux: Unregistering netfilter hooks [ 7.383776] type=1404 audit(1544747352.122:2): selinux=0 auid=4294967295 ses=4294967295 [ 7.397284] ip_tables: (C) 2000-2006 Netfilter Core Team [ 7.398064] systemd[1]: Inserted module 'ip_tables' [ 8.156365] EXT4-fs (vda1): re-mounted. Opts: (null) [ 8.595102] systemd-journald[1264]: Received request to flush runtime journal from PID 1 [ 9.563235] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 9.679202] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.724364] Adding 2098172k swap on /dev/vda2. Priority:-2 extents:1 across:2098172k FS [ 9.746667] cryptd: max_cpu_qlen set to 1000 [ 9.780721] AVX version of gcm_enc/dec engaged. [ 9.781295] AES CTR mode by8 optimization enabled [ 9.873042] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 9.881813] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 9.953190] ppdev: user-space parallel port driver [ 10.130951] type=1305 audit(1544747354.869:3): audit_pid=2353 old=0 auid=4294967295 ses=4294967295 res=1 [ 12.559224] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 12.560311] 8139cp 0000:00:03.0 eth0: link up, 100Mbps, full-duplex, lpa 0x05E1 [ 39.103006] random: crng init done [ 205.010323] FS-Cache: Loaded [ 205.035415] RPC: Registered named UNIX socket transport module. [ 205.036130] RPC: Registered udp transport module. [ 205.036652] RPC: Registered tcp transport module. [ 205.037180] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 205.065514] FS-Cache: Netfs 'nfs' registered for caching [ 205.073364] Key type dns_resolver registered [ 205.101145] NFS: Registering the id_resolver key type [ 205.101751] Key type id_resolver registered [ 205.102207] Key type id_legacy registered [ 229.555224] Rounding down aligned max_sectors from 4294967295 to 4294967288 [ 229.577981] Loading iSCSI transport class v2.0-870. [ 229.587477] iscsi: registered transport (iser) [ 229.644076] RPC: Registered rdma transport module. [ 229.644654] RPC: Registered rdma backchannel transport module. [ 361.769275] libcfs: loading out-of-tree module taints kernel. [ 361.773973] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 361.780980] LNet: HW NUMA nodes: 1, HW CPU cores: 2, npartitions: 1 [ 361.786812] alg: No test for adler32 (adler32-zlib) [ 362.581099] Lustre: Lustre: Build Version: 2.12.0_RC2 [ 362.656676] LNet: Added LNI 10.9.6.156@tcp [8/256/0/180] [ 362.657589] LNet: Accept secure, port 988 [ 364.747156] Lustre: Mounted lustre-client [ 635.296857] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing check_config_client /mnt/lustre [ 636.340750] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing check_logdir /tmp/test_logs/2018-12-14/003939 [ 637.161337] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing yml_node [ 637.653018] Lustre: DEBUG MARKER: Client: Lustre version: 2.12.0_RC2 [ 638.056031] Lustre: DEBUG MARKER: MDS: Lustre version: 2.12.0_RC2 [ 638.461227] Lustre: DEBUG MARKER: OSS: Lustre version: 2.12.0_RC2 [ 638.708727] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity ============----- Fri Dec 14 00:39:43 UTC 2018 [ 639.186294] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing check_config_client /mnt/lustre [ 641.340112] Lustre: DEBUG MARKER: Using TIMEOUT=100 [ 642.280930] Lustre: lustre-OST0000-osc-ffffa124fb682000: reconnect after 253s idle [ 642.614775] Lustre: DEBUG MARKER: excepting tests: 220 225a 225b 228b 407 253 312 42a 42b 42c 77k [ 642.874331] Lustre: DEBUG MARKER: skipping tests SLOW=no: 27m 64b 68 71 115 300o [ 644.808047] Lustre: DEBUG MARKER: == sanity test 0a: touch; rm ========================================================================= 00:39:49 (1544747989) [ 645.997236] Lustre: DEBUG MARKER: == sanity test 0b: chmod 0755 /mnt/lustre ============================================================ 00:39:50 (1544747990) [ 647.143186] Lustre: DEBUG MARKER: == sanity test 0c: check import proc ================================================================= 00:39:51 (1544747991) [ 648.296366] Lustre: DEBUG MARKER: == sanity test 0d: check export proc ================================================================= 00:39:52 (1544747992) [ 650.525062] Lustre: DEBUG MARKER: == sanity test 1: mkdir; remkdir; rmdir ============================================================== 00:39:55 (1544747995) [ 651.690180] Lustre: DEBUG MARKER: == sanity test 2: mkdir; touch; rmdir; check file ==================================================== 00:39:56 (1544747996) [ 652.848204] Lustre: DEBUG MARKER: == sanity test 3: mkdir; touch; rmdir; check dir ===================================================== 00:39:57 (1544747997) [ 654.003126] Lustre: DEBUG MARKER: == sanity test 4: mkdir; touch dir/file; rmdir; checkdir (expect error) ============================== 00:39:58 (1544747998) [ 655.154391] Lustre: DEBUG MARKER: == sanity test 5: mkdir .../d5 .../d5/d2; chmod .../d5/d2 ============================================ 00:39:59 (1544747999) [ 656.383378] Lustre: DEBUG MARKER: == sanity test 6a: touch f6a; chmod f6a; runas -u 500 -g 500 chmod f6a (should return error) ========= 00:40:00 (1544748000) [ 657.558121] Lustre: DEBUG MARKER: == sanity test 6c: touch f6c; chown f6c; runas -u 500 -g 500 chown f6c (should return error) ========= 00:40:02 (1544748002) [ 658.718741] Lustre: DEBUG MARKER: == sanity test 6e: touch+chgrp ; runas -u 500 -g 500 chgrp (should return error) ==================== 00:40:03 (1544748003) [ 659.864738] Lustre: DEBUG MARKER: == sanity test 6g: verify new dir in sgid dir inherits group ========================================= 00:40:04 (1544748004) [ 661.024285] Lustre: DEBUG MARKER: == sanity test 6h: runas -u 500 -g 500 chown RUNAS_ID.0 .../ (should return error) =================== 00:40:05 (1544748005) [ 662.165968] Lustre: DEBUG MARKER: == sanity test 7a: mkdir .../d7; mcreate .../d7/f; chmod .../d7/f ==================================== 00:40:06 (1544748006) [ 663.294352] Lustre: DEBUG MARKER: == sanity test 7b: mkdir .../d7; mcreate d7/f2; echo foo > d7/f2 ===================================== 00:40:07 (1544748007) [ 664.436243] Lustre: DEBUG MARKER: == sanity test 8: mkdir .../d8; touch .../d8/f; chmod .../d8/f ======================================= 00:40:09 (1544748009) [ 665.591655] Lustre: DEBUG MARKER: == sanity test 9: mkdir .../d9 .../d9/d2 .../d9/d2/d3 ================================================ 00:40:10 (1544748010) [ 666.765491] Lustre: DEBUG MARKER: == sanity test 10: mkdir .../d10 .../d10/d2; touch .../d10/d2/f ====================================== 00:40:11 (1544748011) [ 667.935445] Lustre: DEBUG MARKER: == sanity test 11: mkdir .../d11 d11/d2; chmod .../d11/d2 ============================================ 00:40:12 (1544748012) [ 669.362402] Lustre: DEBUG MARKER: == sanity test 12: touch .../d12/f; chmod .../d12/f .../d12/f ======================================== 00:40:13 (1544748013) [ 670.496031] Lustre: DEBUG MARKER: == sanity test 13: creat .../d13/f; dd .../d13/f; > .../d13/f ======================================== 00:40:15 (1544748015) [ 671.630506] Lustre: DEBUG MARKER: == sanity test 14: touch .../d14/f; rm .../d14/f; rm .../d14/f ======================================= 00:40:16 (1544748016) [ 672.757549] Lustre: DEBUG MARKER: == sanity test 15: touch .../d15/f; mv .../d15/f .../d15/f2 ========================================== 00:40:17 (1544748017) [ 673.926126] Lustre: DEBUG MARKER: == sanity test 16: touch .../d16/f; rm -rf .../d16/f ================================================= 00:40:18 (1544748018) [ 675.079659] Lustre: DEBUG MARKER: == sanity test 17a: symlinks: create, remove (real) ================================================== 00:40:19 (1544748019) [ 676.231859] Lustre: DEBUG MARKER: == sanity test 17b: symlinks: create, remove (dangling) ============================================== 00:40:20 (1544748020) [ 677.405582] Lustre: DEBUG MARKER: == sanity test 17c: symlinks: open dangling (should return error) ==================================== 00:40:21 (1544748021) [ 678.559340] Lustre: DEBUG MARKER: == sanity test 17d: symlinks: create dangling ======================================================== 00:40:23 (1544748023) [ 679.679369] Lustre: DEBUG MARKER: == sanity test 17e: symlinks: create recursive symlink (should return error) ========================= 00:40:24 (1544748024) [ 680.824881] Lustre: DEBUG MARKER: == sanity test 17f: symlinks: long and very long symlink name ======================================== 00:40:25 (1544748025) [ 681.995526] Lustre: DEBUG MARKER: == sanity test 17g: symlinks: really long symlink name and inode boundaries ========================== 00:40:26 (1544748026) [ 683.914858] Lustre: DEBUG MARKER: == sanity test 17h: create objects: lov_free_memmd() doesn't lbug ==================================== 00:40:28 (1544748028) [ 685.259262] Lustre: DEBUG MARKER: == sanity test 17i: don't panic on short symlink (should return error) =============================== 00:40:29 (1544748029) [ 685.473227] LustreError: 10838:0:(symlink.c:94:ll_readlink_internal()) lustre: inode [0x20000b7b1:0x4f:0x0]: symlink length 33 not expected 35 [ 686.580790] Lustre: DEBUG MARKER: == sanity test 17k: symlinks: rsync with xattrs enabled ============================================== 00:40:31 (1544748031) [ 687.801886] Lustre: DEBUG MARKER: == sanity test 17l: Ensure lgetxattr's returned xattr size is consistent ============================= 00:40:32 (1544748032) [ 688.958707] Lustre: DEBUG MARKER: == sanity test 17m: run e2fsck against MDT which contains short/long symlink ========================= 00:40:33 (1544748033) [ 715.182645] LustreError: 11-0: lustre-MDT0000-mdc-ffffa124fb682000: operation ldlm_enqueue to node 10.9.6.154@tcp failed: rc = -107 [ 715.184018] Lustre: lustre-MDT0000-mdc-ffffa124fb682000: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 715.237506] Lustre: lustre-MDT0000-mdc-ffffa124fb682000: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 715.971385] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 715.973702] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9efea06197 to 0xad93bf9efea2771f [ 715.976054] Lustre: MGC10.9.6.154@tcp: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 718.373863] Lustre: DEBUG MARKER: == sanity test 17n: run e2fsck against master/slave MDT which contains remote dir ==================== 00:41:02 (1544748062) [ 718.607878] Lustre: DEBUG MARKER: SKIP: sanity test_17n needs >= 2 MDTs [ 718.874632] Lustre: DEBUG MARKER: == sanity test 17o: stat file with incompat LMA feature ============================================== 00:41:03 (1544748063) [ 730.226568] Lustre: 24962:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544748068/real 1544748068] req@ffffa124a9877900 x1619785371747856/t0(0) o101->MGC10.9.6.154@tcp@10.9.6.154@tcp:26/25 lens 328/344 e 0 to 1 dl 1544748075 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 730.229569] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 737.231527] Lustre: 24908:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544748075/real 1544748075] req@ffffa124a9877c00 x1619785371747904/t0(0) o400->lustre-MDT0000-mdc-ffffa124fb682000@10.9.6.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1544748082 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 737.234631] Lustre: lustre-MDT0000-mdc-ffffa124fb682000: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 762.307495] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9efea2771f to 0xad93bf9efea2f828 [ 762.309021] Lustre: MGC10.9.6.154@tcp: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 762.762139] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 763.018484] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 765.640105] Lustre: DEBUG MARKER: == sanity test 18: touch .../f ; ls ... ============================================================== 00:41:50 (1544748110) [ 766.773243] Lustre: DEBUG MARKER: == sanity test 19a: touch .../f19 ; ls -l ... ; rm .../f19 =========================================== 00:41:51 (1544748111) [ 768.327627] Lustre: DEBUG MARKER: == sanity test 19b: ls -l .../f19 (should return error) ============================================== 00:41:52 (1544748112) [ 769.449342] Lustre: DEBUG MARKER: == sanity test 19c: runas -u 500 -g 500 touch .../f19 (should return error) ========================== 00:41:54 (1544748114) [ 770.588294] Lustre: DEBUG MARKER: == sanity test 19d: cat .../f19 (should return error) ================================================ 00:41:55 (1544748115) [ 771.749059] Lustre: DEBUG MARKER: == sanity test 20: touch .../f ; ls -l ... =========================================================== 00:41:56 (1544748116) [ 772.999761] Lustre: DEBUG MARKER: == sanity test 21: write to dangling link ============================================================ 00:41:57 (1544748117) [ 774.150975] Lustre: DEBUG MARKER: == sanity test 22: unpack tar archive as non-root user =============================================== 00:41:58 (1544748118) [ 775.394366] Lustre: DEBUG MARKER: == sanity test 23a: O_CREAT|O_EXCL in subdir ========================================================= 00:41:59 (1544748119) [ 776.544739] Lustre: DEBUG MARKER: == sanity test 23b: O_APPEND check =================================================================== 00:42:01 (1544748121) [ 777.690599] Lustre: DEBUG MARKER: == sanity test 23c: O_APPEND size checks for tiny writes ============================================= 00:42:02 (1544748122) [ 779.691760] Lustre: DEBUG MARKER: == sanity test 23d: file offset is correct after appending writes ==================================== 00:42:04 (1544748124) [ 780.844751] Lustre: DEBUG MARKER: == sanity test 24a: rename file to non-existent target =============================================== 00:42:05 (1544748125) [ 781.984084] Lustre: DEBUG MARKER: == sanity test 24b: rename file to existing target =================================================== 00:42:06 (1544748126) [ 783.138367] Lustre: DEBUG MARKER: == sanity test 24c: rename directory to non-existent target ========================================== 00:42:07 (1544748127) [ 784.298965] Lustre: DEBUG MARKER: == sanity test 24d: rename directory to existing target ============================================== 00:42:08 (1544748128) [ 785.456161] Lustre: DEBUG MARKER: == sanity test 24e: touch .../R5a/f; rename .../R5a/f .../R5b/g ====================================== 00:42:10 (1544748130) [ 786.622534] Lustre: DEBUG MARKER: == sanity test 24f: touch .../R6a/f R6b/g; mv .../R6a/f .../R6b/g ==================================== 00:42:11 (1544748131) [ 787.789871] Lustre: DEBUG MARKER: == sanity test 24g: mkdir .../R7a/d; .../R7b/d; mv .../R7a/d .../R7b/e ====================================== 00:42:12 (1544748132) [ 788.964090] Lustre: DEBUG MARKER: == sanity test 24h: mkdir .../R8a/d; .../R8a/e; .../R8b/d; .../R8b/e; rename .../R8a/d .../R8b/e ============================== 00:42:13 (1544748133) [ 790.114191] Lustre: DEBUG MARKER: == sanity test 24i: rename file to dir error: touch f ; mkdir a ; rename f a ========================= 00:42:14 (1544748134) [ 791.308952] Lustre: DEBUG MARKER: == sanity test 24j: source does not exist ============================================================ 00:42:15 (1544748135) [ 792.488841] Lustre: DEBUG MARKER: == sanity test 24k: touch .../R11a/f; mv .../R11a/f .../R11a/d ======================================= 00:42:17 (1544748137) [ 793.690435] Lustre: DEBUG MARKER: == sanity test 24l: Renaming a file to itself ======================================================== 00:42:18 (1544748138) [ 794.879465] Lustre: DEBUG MARKER: == sanity test 24m: Renaming a file to a hard link to itself ========================================= 00:42:19 (1544748139) [ 796.049650] Lustre: DEBUG MARKER: == sanity test 24n: Statting the old file after renaming (Posix rename 2) ============================ 00:42:20 (1544748140) [ 797.275389] Lustre: DEBUG MARKER: == sanity test 24o: rename of files during htree split =============================================== 00:42:21 (1544748141) [ 850.171877] Lustre: DEBUG MARKER: == sanity test 24p: mkdir .../R12a; .../R12b; rename .../R12a .../R12b ===================================== 00:43:14 (1544748194) [ 851.379846] Lustre: DEBUG MARKER: == sanity test 24q: mkdir .../R13a; .../R13b; open R13b rename R13a R13b =================================== 00:43:15 (1544748195) [ 852.602236] Lustre: DEBUG MARKER: == sanity test 24r: mkdir .../R14a/b; rename .../R14a .../R14a/b ===================================== 00:43:17 (1544748197) [ 853.781810] Lustre: DEBUG MARKER: == sanity test 24s: mkdir .../R15a/b/c; rename .../R15a .../R15a/b/c ================================= 00:43:18 (1544748198) [ 854.967916] Lustre: DEBUG MARKER: == sanity test 24t: mkdir .../R16a/b/c; rename .../R16a/b/c .../R16a ================================= 00:43:19 (1544748199) [ 856.157759] Lustre: DEBUG MARKER: == sanity test 24u: create stripe file =============================================================== 00:43:20 (1544748200) [ 856.175448] Lustre: multiop: using old ioctl(LL_IOC_LOV_GETSTRIPE) on [0x20000b7b1:0x2dc1:0x0], use llapi_layout_get_by_path() [ 857.388047] Lustre: DEBUG MARKER: == sanity test 24v: list large directory (test hash collision, b=17560) ============================== 00:43:21 (1544748201) [ 859.822794] Lustre: DEBUG MARKER: == sanity test 24w: Reading a file larger than 4Gb =================================================== 00:43:24 (1544748204) [ 861.056026] Lustre: DEBUG MARKER: == sanity test 24x: cross MDT rename/link ============================================================ 00:43:25 (1544748205) [ 861.288785] Lustre: DEBUG MARKER: SKIP: sanity test_24x needs >= 2 MDTs [ 861.549476] Lustre: DEBUG MARKER: == sanity test 24y: rename/link on the same dir should succeed ======================================= 00:43:26 (1544748206) [ 861.782613] Lustre: DEBUG MARKER: SKIP: sanity test_24y needs >= 2 MDTs [ 862.038915] Lustre: DEBUG MARKER: == sanity test 24A: readdir() returns correct number of entries. ===================================== 00:43:26 (1544748206) [ 876.106835] Lustre: DEBUG MARKER: == sanity test 24B: readdir for striped dir return correct number of entries ========================= 00:43:40 (1544748220) [ 876.336467] Lustre: DEBUG MARKER: SKIP: sanity test_24B needs >= 2 MDTs [ 876.593297] Lustre: DEBUG MARKER: == sanity test 24C: check .. in striped dir ========================================================== 00:43:41 (1544748221) [ 876.828391] Lustre: DEBUG MARKER: SKIP: sanity test_24C needs >= 2 MDTs [ 877.085672] Lustre: DEBUG MARKER: == sanity test 24E: cross MDT rename/link ============================================================ 00:43:41 (1544748221) [ 877.317837] Lustre: DEBUG MARKER: SKIP: sanity test_24E needs >= 4 MDTs [ 877.574834] Lustre: DEBUG MARKER: == sanity test 25a: create file in symlinked directory =============================================== 00:43:42 (1544748222) [ 878.809080] Lustre: DEBUG MARKER: == sanity test 25b: lookup file in symlinked directory =============================================== 00:43:43 (1544748223) [ 879.954407] Lustre: DEBUG MARKER: == sanity test 26a: multiple component symlink ======================================================= 00:43:44 (1544748224) [ 881.114889] Lustre: DEBUG MARKER: == sanity test 26b: multiple component symlink at end of lookup ====================================== 00:43:45 (1544748225) [ 882.281894] Lustre: DEBUG MARKER: == sanity test 26c: chain of symlinks ================================================================ 00:43:46 (1544748226) [ 883.449215] Lustre: DEBUG MARKER: == sanity test 26d: create multiple component recursive symlink ====================================== 00:43:48 (1544748228) [ 884.603168] Lustre: DEBUG MARKER: == sanity test 26e: unlink multiple component recursive symlink ====================================== 00:43:49 (1544748229) [ 885.758098] Lustre: DEBUG MARKER: == sanity test 26f: rm -r of a directory which has recursive symlink ================================= 00:43:50 (1544748230) [ 886.998175] Lustre: DEBUG MARKER: == sanity test 27a: one stripe file ================================================================== 00:43:51 (1544748231) [ 888.187382] Lustre: DEBUG MARKER: == sanity test 27b: create and write to two stripe file ============================================== 00:43:52 (1544748232) [ 888.421753] Lustre: DEBUG MARKER: SKIP: sanity test_27b needs >= 2 OSTs [ 888.681805] Lustre: DEBUG MARKER: == sanity test 27d: create file with default settings ================================================ 00:43:53 (1544748233) [ 889.854729] Lustre: DEBUG MARKER: == sanity test 27e: setstripe existing file (should return error) ==================================== 00:43:54 (1544748234) [ 891.204940] Lustre: DEBUG MARKER: == sanity test 27f: setstripe with bad stripe size (should return error) ============================= 00:43:55 (1544748235) [ 892.404803] Lustre: DEBUG MARKER: == sanity test 27g: /bin/lfs getstripe with no objects =============================================== 00:43:56 (1544748236) [ 893.564511] Lustre: DEBUG MARKER: == sanity test 27i: /bin/lfs getstripe with some objects ============================================= 00:43:58 (1544748238) [ 894.733584] Lustre: DEBUG MARKER: == sanity test 27j: setstripe with bad stripe offset (should return error) =========================== 00:43:59 (1544748239) [ 895.888179] Lustre: DEBUG MARKER: == sanity test 27k: limit i_blksize for broken user apps ============================================= 00:44:00 (1544748240) [ 897.071880] Lustre: DEBUG MARKER: == sanity test 27l: check setstripe permissions (should return error) ================================ 00:44:01 (1544748241) [ 898.203215] Lustre: DEBUG MARKER: SKIP: sanity test_27m skipping SLOW test 27m [ 898.457474] Lustre: DEBUG MARKER: == sanity test 27n: create file with some full OSTs ================================================== 00:44:03 (1544748243) [ 898.690892] Lustre: DEBUG MARKER: SKIP: sanity test_27n needs >= 2 OSTs [ 898.948438] Lustre: DEBUG MARKER: == sanity test 27o: create file with all full OSTs (should error) ==================================== 00:44:03 (1544748243) [ 899.182624] Lustre: DEBUG MARKER: SKIP: sanity test_27o needs >= 2 OSTs [ 899.440514] Lustre: DEBUG MARKER: == sanity test 27p: append to a truncated file with some full OSTs =================================== 00:44:04 (1544748244) [ 899.673802] Lustre: DEBUG MARKER: SKIP: sanity test_27p needs >= 2 OSTs [ 899.934132] Lustre: DEBUG MARKER: == sanity test 27q: append to truncated file with all OSTs full (should error) ======================= 00:44:04 (1544748244) [ 900.168234] Lustre: DEBUG MARKER: SKIP: sanity test_27q needs >= 2 OSTs [ 900.434793] Lustre: DEBUG MARKER: == sanity test 27r: stripe file with some full OSTs (shouldn't LBUG) ================================= 00:44:05 (1544748245) [ 900.673436] Lustre: DEBUG MARKER: SKIP: sanity test_27r needs >= 2 OSTs [ 900.935477] Lustre: DEBUG MARKER: == sanity test 27s: lsm_xfersize overflow (should error) (bug 10725) ================================= 00:44:05 (1544748245) [ 902.123390] Lustre: DEBUG MARKER: == sanity test 27t: check that utils parse path correctly ============================================ 00:44:06 (1544748246) [ 903.282577] Lustre: DEBUG MARKER: == sanity test 27u: skip object creation on OSC w/o objects ========================================== 00:44:07 (1544748247) [ 903.519245] Lustre: DEBUG MARKER: SKIP: sanity test_27u needs >= 2 OSTs [ 903.792433] Lustre: DEBUG MARKER: == sanity test 27v: skip object creation on slow OST ================================================= 00:44:08 (1544748248) [ 904.030222] Lustre: DEBUG MARKER: SKIP: sanity test_27v needs >= 2 OSTs [ 904.290860] Lustre: DEBUG MARKER: == sanity test 27w: check /bin/lfs setstripe -S and getstrip -d options ============================== 00:44:08 (1544748248) [ 905.483595] Lustre: DEBUG MARKER: == sanity test 27wa: check /bin/lfs setstripe -c -i options ========================================== 00:44:10 (1544748250) [ 905.722233] Lustre: DEBUG MARKER: SKIP: sanity test_27wa skipping multiple stripe count/offset test [ 905.981627] Lustre: DEBUG MARKER: == sanity test 27x: create files while OST0 is degraded ============================================== 00:44:10 (1544748250) [ 906.242466] Lustre: DEBUG MARKER: SKIP: sanity test_27x needs >= 2 OSTs [ 906.509791] Lustre: DEBUG MARKER: == sanity test 27y: create files while OST0 is degraded and the rest inactive ======================== 00:44:11 (1544748251) [ 906.743703] Lustre: DEBUG MARKER: SKIP: sanity test_27y needs >= 2 OSTs [ 907.013602] Lustre: DEBUG MARKER: == sanity test 27z: check SEQ/OID on the MDT and OST filesystems ===================================== 00:44:11 (1544748251) [ 913.030767] Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-1 [ 913.286441] Lustre: DEBUG MARKER: FID seq 0x20000b7b1, oid 0x417e ver 0x0 [ 913.517362] Lustre: DEBUG MARKER: LOV seq 0x20000b7b1, oid 0x417e, count: 1 [ 913.760212] Lustre: DEBUG MARKER: want: stripe:0 ost:0 oid:403306/0x6276a seq:0 [ 914.284596] Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-2 [ 914.543039] Lustre: DEBUG MARKER: FID seq 0x20000b7b1, oid 0x4180 ver 0x0 [ 914.775816] Lustre: DEBUG MARKER: LOV seq 0x20000b7b1, oid 0x4180, count: 1 [ 915.025048] Lustre: DEBUG MARKER: want: stripe:0 ost:0 oid:403307/0x6276b seq:0 [ 916.441055] Lustre: DEBUG MARKER: == sanity test 27A: check filesystem-wide default LOV EA values ====================================== 00:44:21 (1544748261) [ 917.820887] Lustre: DEBUG MARKER: == sanity test 27B: call setstripe on open unlinked file/rename victim =============================== 00:44:22 (1544748262) [ 919.018430] Lustre: DEBUG MARKER: == sanity test 27C: check full striping across all OSTs ============================================== 00:44:23 (1544748263) [ 919.266589] Lustre: DEBUG MARKER: SKIP: sanity test_27C needs >= 2 OSTs [ 919.550578] Lustre: DEBUG MARKER: == sanity test 27D: validate llapi_layout API ======================================================== 00:44:24 (1544748264) [ 919.788265] Lustre: DEBUG MARKER: SKIP: sanity test_27D needs >= 2 OSTs [ 920.058684] Lustre: DEBUG MARKER: == sanity test 27E: check that default extended attribute size properly increases ==================== 00:44:24 (1544748264) [ 920.319991] Lustre: DEBUG MARKER: SKIP: sanity test_27E needs >= 2 OSTs [ 920.579580] Lustre: DEBUG MARKER: == sanity test 27F: Client resend delayed layout creation with non-zero size ========================= 00:44:25 (1544748265) [ 920.815448] Lustre: DEBUG MARKER: SKIP: sanity test_27F needs >= 2 OSTs [ 921.079242] Lustre: DEBUG MARKER: == sanity test 27G: Clear OST pool from stripe ======================================================= 00:44:25 (1544748265) [ 950.397050] Lustre: DEBUG MARKER: == sanity test 27H: Set specific OSTs stripe ========================================================= 00:44:54 (1544748294) [ 950.811642] Lustre: DEBUG MARKER: SKIP: sanity test_27H needs >= 3 OSTs [ 951.074544] Lustre: DEBUG MARKER: == sanity test 28: create/mknod/mkdir with bad file types ============================================ 00:44:55 (1544748295) [ 952.396992] Lustre: DEBUG MARKER: == sanity test 29: IT_GETATTR regression ============================================================ 00:44:56 (1544748296) [ 954.001328] Lustre: DEBUG MARKER: first d29 [ 954.264342] Lustre: DEBUG MARKER: second d29 [ 954.504645] Lustre: DEBUG MARKER: done [ 955.681444] Lustre: DEBUG MARKER: == sanity test 30a: execute binary from Lustre (execve) ============================================== 00:45:00 (1544748300) [ 956.870343] Lustre: DEBUG MARKER: == sanity test 30b: execute binary from Lustre as non-root =========================================== 00:45:01 (1544748301) [ 958.152984] Lustre: DEBUG MARKER: == sanity test 30c: execute binary from Lustre without read perms ==================================== 00:45:02 (1544748302) [ 959.421179] Lustre: DEBUG MARKER: == sanity test 31a: open-unlink file ================================================================= 00:45:03 (1544748303) [ 960.656069] Lustre: DEBUG MARKER: == sanity test 31b: unlink file with multiple links while open ======================================= 00:45:05 (1544748305) [ 961.833211] Lustre: DEBUG MARKER: == sanity test 31c: open-unlink file with multiple links ============================================= 00:45:06 (1544748306) [ 963.017569] Lustre: DEBUG MARKER: == sanity test 31d: remove of open directory ========================================================= 00:45:07 (1544748307) [ 964.207201] Lustre: DEBUG MARKER: == sanity test 31e: remove of open non-empty directory =============================================== 00:45:08 (1544748308) [ 965.386755] Lustre: DEBUG MARKER: == sanity test 31f: remove of open directory with open-unlink file =================================== 00:45:09 (1544748309) [ 972.633912] Lustre: DEBUG MARKER: == sanity test 31g: cross directory link============================================================== 00:45:17 (1544748317) [ 973.819542] Lustre: DEBUG MARKER: == sanity test 31h: cross directory link under child================================================== 00:45:18 (1544748318) [ 975.012387] Lustre: DEBUG MARKER: == sanity test 31i: cross directory link under parent================================================= 00:45:19 (1544748319) [ 976.216773] Lustre: DEBUG MARKER: == sanity test 31j: link for directory================================================================ 00:45:20 (1544748320) [ 977.416244] Lustre: DEBUG MARKER: == sanity test 31k: link to file: the same, non-existing, dir========================================= 00:45:21 (1544748321) [ 978.640219] Lustre: DEBUG MARKER: == sanity test 31m: link to file: the same, non-existing, dir========================================= 00:45:23 (1544748323) [ 979.861903] Lustre: DEBUG MARKER: == sanity test 31n: check link count of unlinked file ================================================ 00:45:24 (1544748324) [ 981.084849] Lustre: DEBUG MARKER: == sanity test 31o: duplicate hard links with same filename ========================================== 00:45:25 (1544748325) [ 989.644403] Lustre: DEBUG MARKER: == sanity test 31p: remove of open striped directory ================================================= 00:45:34 (1544748334) [ 989.890124] Lustre: DEBUG MARKER: SKIP: sanity test_31p needs >= 2 MDTs [ 990.159775] Lustre: DEBUG MARKER: == sanity test 32a: stat d32a/ext2-mountpoint/.. ===================================================== 00:45:34 (1544748334) [ 990.196124] loop: module loaded [ 990.199194] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 990.204417] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 991.579161] Lustre: DEBUG MARKER: == sanity test 32b: open d32b/ext2-mountpoint/.. ===================================================== 00:45:36 (1544748336) [ 991.599887] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 991.601012] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 992.860959] Lustre: DEBUG MARKER: == sanity test 32c: stat d32c/ext2-mountpoint/../d2/test_dir ========================================= 00:45:37 (1544748337) [ 992.910950] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 992.913124] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 994.402242] Lustre: DEBUG MARKER: == sanity test 32d: open d32d/ext2-mountpoint/../d2/test_dir ========================================= 00:45:38 (1544748338) [ 994.424359] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 994.426386] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 995.824989] Lustre: DEBUG MARKER: == sanity test 32e: stat d32e/symlink->tmp/symlink->lustre-subdir ==================================== 00:45:40 (1544748340) [ 997.052088] Lustre: DEBUG MARKER: == sanity test 32f: open d32f/symlink->tmp/symlink->lustre-subdir ==================================== 00:45:41 (1544748341) [ 998.280979] Lustre: DEBUG MARKER: == sanity test 32g: stat d32g/symlink->tmp/symlink->lustre-subdir/2 ================================== 00:45:42 (1544748342) [ 999.553040] Lustre: DEBUG MARKER: == sanity test 32h: open d32h/symlink->tmp/symlink->lustre-subdir/2 ================================== 00:45:44 (1544748344) [ 1000.811877] Lustre: DEBUG MARKER: == sanity test 32i: stat d32i/ext2-mountpoint/../test_file =========================================== 00:45:45 (1544748345) [ 1000.835137] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 1000.836560] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1002.129877] Lustre: DEBUG MARKER: == sanity test 32j: open d32j/ext2-mountpoint/../test_file =========================================== 00:45:46 (1544748346) [ 1002.154318] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 1002.155528] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1003.420616] Lustre: DEBUG MARKER: == sanity test 32k: stat d32k/ext2-mountpoint/../d2/test_file ======================================== 00:45:48 (1544748348) [ 1003.447138] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 1003.448188] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1004.787878] Lustre: DEBUG MARKER: == sanity test 32l: open d32l/ext2-mountpoint/../d2/test_file ======================================== 00:45:49 (1544748349) [ 1004.814048] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 1004.815687] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1006.227888] Lustre: DEBUG MARKER: == sanity test 32m: stat d32m/symlink->tmp/symlink->lustre-root ====================================== 00:45:50 (1544748350) [ 1007.471459] Lustre: DEBUG MARKER: == sanity test 32n: open d32n/symlink->tmp/symlink->lustre-root ====================================== 00:45:52 (1544748352) [ 1008.718612] Lustre: DEBUG MARKER: == sanity test 32o: stat d32o/symlink->tmp/symlink->lustre-root/ ===================================== 00:45:53 (1544748353) [ 1009.952831] Lustre: DEBUG MARKER: == sanity test 32p: open d32p/symlink->tmp/symlink->lustre-root/ ===================================== 00:45:54 (1544748354) [ 1010.201308] Lustre: DEBUG MARKER: 32p_1 [ 1010.457513] Lustre: DEBUG MARKER: 32p_2 [ 1010.701678] Lustre: DEBUG MARKER: 32p_3 [ 1010.954002] Lustre: DEBUG MARKER: 32p_4 [ 1011.210115] Lustre: DEBUG MARKER: 32p_5 [ 1011.463537] Lustre: DEBUG MARKER: 32p_6 [ 1011.724051] Lustre: DEBUG MARKER: 32p_7 [ 1011.983233] Lustre: DEBUG MARKER: 32p_8 [ 1012.256850] Lustre: DEBUG MARKER: 32p_9 [ 1012.515063] Lustre: DEBUG MARKER: 32p_10 [ 1013.741995] Lustre: DEBUG MARKER: == sanity test 32q: stat follows mountpoints in Lustre (should return error) ========================= 00:45:58 (1544748358) [ 1013.775994] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 1013.777141] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1015.217464] Lustre: DEBUG MARKER: == sanity test 32r: opendir follows mountpoints in Lustre (should return error) ====================== 00:45:59 (1544748359) [ 1015.246363] EXT4-fs (loop0): mounting ext2 file system using the ext4 subsystem [ 1015.247615] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 1016.528219] Lustre: DEBUG MARKER: == sanity test 33aa: write file with mode 444 (should return error) ================================== 00:46:01 (1544748361) [ 1016.793862] Lustre: DEBUG MARKER: 33_1 [ 1017.041003] Lustre: DEBUG MARKER: 33_2 [ 1018.232461] Lustre: DEBUG MARKER: == sanity test 33a: test open file(mode=0444) with O_RDWR (should return error) ====================== 00:46:02 (1544748362) [ 1019.516477] Lustre: DEBUG MARKER: == sanity test 33b: test open file with malformed flags (No panic) =================================== 00:46:04 (1544748364) [ 1020.808771] Lustre: DEBUG MARKER: == sanity test 33c: test llobdstat and write_bytes =================================================== 00:46:05 (1544748365) [ 1022.424530] Lustre: DEBUG MARKER: == sanity test 33d: openfile with 444 modes and malformed flags under remote dir ===================== 00:46:07 (1544748367) [ 1022.664856] Lustre: DEBUG MARKER: SKIP: sanity test_33d needs >= 2 MDTs [ 1022.939767] Lustre: DEBUG MARKER: == sanity test 33e: mkdir and striped directory should have same mode ================================ 00:46:07 (1544748367) [ 1023.176267] Lustre: DEBUG MARKER: SKIP: sanity test_33e needs >= 2 MDTs [ 1023.452883] Lustre: DEBUG MARKER: == sanity test 33f: nonroot user can create, access, and remove a striped directory ================== 00:46:08 (1544748368) [ 1023.705353] Lustre: DEBUG MARKER: SKIP: sanity test_33f needs >= 2 MDTs [ 1023.975340] Lustre: DEBUG MARKER: == sanity test 33g: nonroot user create already existing root created file =========================== 00:46:08 (1544748368) [ 1025.203788] Lustre: DEBUG MARKER: == sanity test 34a: truncate file that has not been opened =========================================== 00:46:09 (1544748369) [ 1026.445027] Lustre: DEBUG MARKER: == sanity test 34b: O_RDONLY opening file doesn't create objects ===================================== 00:46:11 (1544748371) [ 1027.681319] Lustre: DEBUG MARKER: == sanity test 34c: O_RDWR opening file-with-size works ============================================== 00:46:12 (1544748372) [ 1028.931309] Lustre: DEBUG MARKER: == sanity test 34d: write to sparse file ============================================================= 00:46:13 (1544748373) [ 1030.158758] Lustre: DEBUG MARKER: == sanity test 34e: create objects, some with size and some without ================================== 00:46:14 (1544748374) [ 1031.378958] Lustre: DEBUG MARKER: == sanity test 34f: read from a file with no objects until EOF ======================================= 00:46:15 (1544748375) [ 1032.607435] Lustre: DEBUG MARKER: == sanity test 34g: truncate long file =============================================================== 00:46:17 (1544748377) [ 1033.840891] Lustre: DEBUG MARKER: == sanity test 34h: ftruncate file under grouplock should not block ================================== 00:46:18 (1544748378) [ 1038.162720] Lustre: DEBUG MARKER: == sanity test 35a: exec file with mode 444 (should return and not leak) ============================= 00:46:22 (1544748382) [ 1039.521462] Lustre: DEBUG MARKER: == sanity test 36a: MDS utime check (mknod, utime) =================================================== 00:46:24 (1544748384) [ 1040.746353] Lustre: DEBUG MARKER: == sanity test 36b: OST utime check (open, utime) ==================================================== 00:46:25 (1544748385) [ 1041.952861] Lustre: DEBUG MARKER: == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================== 00:46:26 (1544748386) [ 1043.235230] Lustre: DEBUG MARKER: == sanity test 36d: non-root OST utime check (open, utime) =========================================== 00:46:27 (1544748387) [ 1044.487322] Lustre: DEBUG MARKER: == sanity test 36e: utime on non-owned file (should return error) ==================================== 00:46:29 (1544748389) [ 1045.685231] Lustre: DEBUG MARKER: == sanity test 36f: utime on file racing with OST BRW write ========================================== 00:46:30 (1544748390) [ 1047.932837] Lustre: DEBUG MARKER: == sanity test 36g: filter mod data cache expiry ===================================================== 00:46:32 (1544748392) [ 1171.678034] Lustre: DEBUG MARKER: == sanity test 36h: utime on file racing with OST BRW write ========================================== 00:48:36 (1544748516) [ 1173.911469] Lustre: DEBUG MARKER: == sanity test 36i: change mtime on striped directory ================================================ 00:48:38 (1544748518) [ 1174.151633] Lustre: DEBUG MARKER: SKIP: sanity test_36i needs >= 2 MDTs [ 1174.424178] Lustre: DEBUG MARKER: == sanity test 38: open a regular file with O_DIRECTORY should return -ENOTDIR ======================= 00:48:38 (1544748518) [ 1175.625460] Lustre: DEBUG MARKER: == sanity test 39a: mtime changed on create ========================================================== 00:48:40 (1544748520) [ 1178.876908] Lustre: DEBUG MARKER: == sanity test 39b: mtime change on open, link, unlink, rename ====================================== 00:48:43 (1544748523) [ 1181.253781] Lustre: DEBUG MARKER: == sanity test 39c: mtime change on rename =========================================================== 00:48:45 (1544748525) [ 1184.500022] Lustre: DEBUG MARKER: == sanity test 39d: create, utime, stat ============================================================== 00:48:49 (1544748529) [ 1185.732489] Lustre: DEBUG MARKER: == sanity test 39e: create, stat, utime, stat ======================================================== 00:48:50 (1544748530) [ 1186.961435] Lustre: DEBUG MARKER: == sanity test 39f: create, stat, sleep, utime, stat ================================================= 00:48:51 (1544748531) [ 1190.187895] Lustre: DEBUG MARKER: == sanity test 39g: write, chmod, stat =============================================================== 00:48:54 (1544748534) [ 1193.409258] Lustre: DEBUG MARKER: == sanity test 39h: write, utime within one second, stat ============================================= 00:48:57 (1544748537) [ 1195.641854] Lustre: DEBUG MARKER: == sanity test 39i: write, rename, stat ============================================================== 00:49:00 (1544748540) [ 1197.884245] Lustre: DEBUG MARKER: == sanity test 39j: write, rename, close, stat ======================================================= 00:49:02 (1544748542) [ 1199.594924] LustreError: 23989:0:(fail.c:129:__cfs_fail_timeout_set()) cfs_fail_timeout id 412 sleeping for 1000ms [ 1200.596046] LustreError: 23989:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 412 awake [ 1202.367153] Lustre: DEBUG MARKER: == sanity test 39k: write, utime, close, stat ======================================================== 00:49:06 (1544748546) [ 1204.711948] Lustre: DEBUG MARKER: == sanity test 39l: directory atime update =========================================================== 00:49:09 (1544748549) [ 1212.641693] Lustre: DEBUG MARKER: == sanity test 39m: test atime and mtime before 1970 ================================================= 00:49:17 (1544748557) [ 1215.873626] Lustre: DEBUG MARKER: == sanity test 39n: check that O_NOATIME is honored ================================================== 00:49:20 (1544748560) [ 1227.659609] Lustre: DEBUG MARKER: == sanity test 39o: directory cached attributes updated after create ================================= 00:49:32 (1544748572) [ 1228.940372] Lustre: DEBUG MARKER: == sanity test 39p: remote directory cached attributes updated after create ========================== 00:49:33 (1544748573) [ 1229.187236] Lustre: DEBUG MARKER: SKIP: sanity test_39p needs >= 2 MDTs [ 1229.473186] Lustre: DEBUG MARKER: == sanity test 39q: close won't zero out atime ======================================================= 00:49:34 (1544748574) [ 1230.704785] Lustre: DEBUG MARKER: == sanity test 40: failed open(O_TRUNC) doesn't truncate ============================================= 00:49:35 (1544748575) [ 1231.969860] Lustre: DEBUG MARKER: == sanity test 41: test small file write + fstat ===================================================== 00:49:36 (1544748576) [ 1234.148472] Lustre: DEBUG MARKER: SKIP: sanity test_42a skipping ALWAYS excluded test 42a [ 1234.398680] Lustre: DEBUG MARKER: SKIP: sanity test_42b skipping ALWAYS excluded test 42b [ 1234.647949] Lustre: DEBUG MARKER: SKIP: sanity test_42c skipping ALWAYS excluded test 42c [ 1234.907779] Lustre: DEBUG MARKER: == sanity test 42d: test complete truncate of file with cached dirty data ============================ 00:49:39 (1544748579) [ 1237.997872] Lustre: DEBUG MARKER: == sanity test 42e: verify sub-RPC writes are not done synchronously ================================= 00:49:42 (1544748582) [ 1271.862375] Lustre: DEBUG MARKER: == sanity test 43A: execution of file opened for write should return -ETXTBSY ======================== 00:50:16 (1544748616) [ 1274.136178] Lustre: DEBUG MARKER: == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================= 00:50:18 (1544748618) [ 1275.356934] Lustre: DEBUG MARKER: == sanity test 43b: truncate of file being executed should return -ETXTBSY =========================== 00:50:19 (1544748619) [ 1276.572253] Lustre: DEBUG MARKER: == sanity test 43c: md5sum of copy into lustre ======================================================= 00:50:21 (1544748621) [ 1277.804754] Lustre: DEBUG MARKER: == sanity test 44A: zero length read from a sparse stripe ============================================ 00:50:22 (1544748622) [ 1278.076730] Lustre: DEBUG MARKER: SKIP: sanity test_44A needs >= 2 OSTs [ 1278.443988] Lustre: DEBUG MARKER: == sanity test 44a: test sparse pwrite =============================================================== 00:50:22 (1544748622) [ 1279.907038] Lustre: DEBUG MARKER: == sanity test 45: osc io page accounting ============================================================ 00:50:24 (1544748624) [ 1281.573906] Lustre: DEBUG MARKER: == sanity test 46: dirtying a previously written page ================================================ 00:50:26 (1544748626) [ 1283.111534] Lustre: DEBUG MARKER: == sanity test 48a: Access renamed working dir (should return errors)================================= 00:50:27 (1544748627) [ 1284.340012] Lustre: DEBUG MARKER: == sanity test 48b: Access removed working dir (should return errors)================================= 00:50:28 (1544748628) [ 1285.559981] Lustre: DEBUG MARKER: == sanity test 48c: Access removed working subdir (should return errors) ============================= 00:50:30 (1544748630) [ 1286.773454] Lustre: DEBUG MARKER: == sanity test 48d: Access removed parent subdir (should return errors) ============================== 00:50:31 (1544748631) [ 1287.995682] Lustre: DEBUG MARKER: == sanity test 48e: Access to recreated parent subdir (should return errors) ========================= 00:50:32 (1544748632) [ 1289.215014] Lustre: DEBUG MARKER: == sanity test 49: Change max_pages_per_rpc won't break osc extent =================================== 00:50:33 (1544748633) [ 1290.613157] Lustre: DEBUG MARKER: == sanity test 50: special situations: /proc symlinks =============================================== 00:50:35 (1544748635) [ 1291.798639] Lustre: DEBUG MARKER: == sanity test 51a: special situations: split htree with empty entry ================================= 00:50:36 (1544748636) [ 1293.283931] Lustre: DEBUG MARKER: == sanity test 51b: exceed 64k subdirectory nlink limit on create, verify unlink ===================== 00:50:37 (1544748637) [ 1486.324894] Lustre: DEBUG MARKER: == sanity test 51d: check object distribution ======================================================== 00:53:50 (1544748830) [ 1486.565239] Lustre: DEBUG MARKER: SKIP: sanity test_51d needs >= 3 OSTs [ 1486.834989] Lustre: DEBUG MARKER: == sanity test 51e: check file nlink limit =========================================================== 00:53:51 (1544748831) [ 1735.016134] Lustre: DEBUG MARKER: == sanity test 51f: check many open files limit ====================================================== 00:57:59 (1544749079) [ 2108.662912] Lustre: DEBUG MARKER: == sanity test 52a: append-only flag test (should return errors) ===================================== 01:04:13 (1544749453) [ 2110.016169] Lustre: DEBUG MARKER: == sanity test 52b: immutable flag test (should return errors) ======================================= 01:04:14 (1544749454) [ 2111.299904] Lustre: DEBUG MARKER: == sanity test 53: verify that MDS and OSTs agree on pre-creation ==================================== 01:04:15 (1544749455) [ 2112.024230] Lustre: DEBUG MARKER: sanity test_53: @@@@@@ FAIL: can not match last_seq/last_id for *OST*-osc- [ 2126.379276] Lustre: DEBUG MARKER: == sanity test 54a: unix domain socket test ========================================================== 01:04:30 (1544749470) [ 2127.751355] Lustre: DEBUG MARKER: == sanity test 54b: char device works in lustre ====================================================== 01:04:32 (1544749472) [ 2128.991534] Lustre: DEBUG MARKER: == sanity test 54c: block device works in lustre ===================================================== 01:04:33 (1544749473) [ 2129.768199] EXT4-fs (loop3): mounting ext2 file system using the ext4 subsystem [ 2129.777060] EXT4-fs (loop3): mounted filesystem without journal. Opts: (null) [ 2131.114318] Lustre: DEBUG MARKER: == sanity test 54d: fifo device works in lustre ====================================================== 01:04:35 (1544749475) [ 2132.377688] Lustre: DEBUG MARKER: == sanity test 54e: console/tty device works in lustre =============================================== 01:04:36 (1544749476) [ 2133.619713] Lustre: DEBUG MARKER: == sanity test 56a: check /bin/lfs getstripe ========================================================= 01:04:38 (1544749478) [ 2134.040355] Lustre: DEBUG MARKER: SKIP: sanity test_56a needs >= 2 OSTs [ 2134.320976] Lustre: DEBUG MARKER: == sanity test 56b: check /bin/lfs getdirstripe ====================================================== 01:04:38 (1544749478) [ 2135.626743] Lustre: DEBUG MARKER: == sanity test 56c: check 'lfs df' showing device status ============================================= 01:04:40 (1544749480) [ 2157.583401] Lustre: DEBUG MARKER: == sanity test 56g: check lfs find -name ============================================================= 01:05:02 (1544749502) [ 2158.919476] Lustre: DEBUG MARKER: == sanity test 56h: check lfs find ! -name =========================================================== 01:05:03 (1544749503) [ 2160.185317] Lustre: DEBUG MARKER: == sanity test 56i: check 'lfs find -ost UUID' skips directories ===================================== 01:05:04 (1544749504) [ 2161.384756] Lustre: DEBUG MARKER: == sanity test 56j: check lfs find -type d =========================================================== 01:05:06 (1544749506) [ 2162.672054] Lustre: DEBUG MARKER: == sanity test 56k: check lfs find -type f =========================================================== 01:05:07 (1544749507) [ 2163.878109] Lustre: DEBUG MARKER: == sanity test 56l: check lfs find -type b =========================================================== 01:05:08 (1544749508) [ 2165.077801] Lustre: DEBUG MARKER: == sanity test 56m: check lfs find -type c =========================================================== 01:05:09 (1544749509) [ 2166.283188] Lustre: DEBUG MARKER: == sanity test 56n: check lfs find -type l =========================================================== 01:05:10 (1544749510) [ 2167.493043] Lustre: DEBUG MARKER: == sanity test 56o: check lfs find -mtime for old files ============================================== 01:05:12 (1544749512) [ 2170.157334] Lustre: DEBUG MARKER: == sanity test 56p: check lfs find -uid and ! -uid =================================================== 01:05:14 (1544749514) [ 2171.486317] Lustre: DEBUG MARKER: == sanity test 56q: check lfs find -gid and ! -gid =================================================== 01:05:16 (1544749516) [ 2172.826666] Lustre: DEBUG MARKER: == sanity test 56r: check lfs find -size works ======================================================= 01:05:17 (1544749517) [ 2174.503415] Lustre: DEBUG MARKER: == sanity test 56s: check lfs find -stripe-count works =============================================== 01:05:19 (1544749519) [ 2174.749557] Lustre: DEBUG MARKER: SKIP: sanity test_56s need at least 2 OSTs [ 2175.022056] Lustre: DEBUG MARKER: == sanity test 56t: check lfs find -stripe-size works ================================================ 01:05:19 (1544749519) [ 2176.605210] Lustre: DEBUG MARKER: == sanity test 56u: check lfs find -stripe-index works =============================================== 01:05:21 (1544749521) [ 2178.023044] Lustre: DEBUG MARKER: == sanity test 56v: check 'lfs find -m match with lfs getstripe -m' ================================== 01:05:22 (1544749522) [ 2179.456379] Lustre: DEBUG MARKER: == sanity test 56w: check lfs_migrate -c stripe_count works ========================================== 01:05:24 (1544749524) [ 2179.700459] Lustre: DEBUG MARKER: SKIP: sanity test_56w needs >= 2 OSTs [ 2179.970834] Lustre: DEBUG MARKER: == sanity test 56wb: check lfs_migrate pool support ================================================== 01:05:24 (1544749524) [ 2221.014821] Lustre: DEBUG MARKER: == sanity test 56wc: check unrecognized options for lfs_migrate are passed through =================== 01:06:05 (1544749565) [ 2223.099376] Lustre: DEBUG MARKER: == sanity test 56wd: check lfs_migrate --rsync and --no-rsync work =================================== 01:06:07 (1544749567) [ 2223.351750] Lustre: DEBUG MARKER: SKIP: sanity test_56wd needs >= 2 OSTs [ 2223.625060] Lustre: DEBUG MARKER: == sanity test 56x: lfs migration support ============================================================ 01:06:08 (1544749568) [ 2223.876389] Lustre: DEBUG MARKER: SKIP: sanity test_56x needs >= 2 OSTs [ 2224.153362] Lustre: DEBUG MARKER: == sanity test 56xa: lfs migration --block support =================================================== 01:06:08 (1544749568) [ 2224.405524] Lustre: DEBUG MARKER: SKIP: sanity test_56xa needs >= 2 OSTs [ 2224.676847] Lustre: DEBUG MARKER: == sanity test 56xb: lfs migration hard link support ================================================= 01:06:09 (1544749569) [ 2247.679631] Lustre: DEBUG MARKER: == sanity test 56y: lfs find -L raid0|released ======================================================= 01:06:32 (1544749592) [ 2249.157900] Lustre: DEBUG MARKER: == sanity test 56z: lfs find should continue after an error ========================================== 01:06:33 (1544749593) [ 2250.661852] Lustre: DEBUG MARKER: == sanity test 56aa: lfs find --size under striped dir =============================================== 01:06:35 (1544749595) [ 2250.934922] Lustre: DEBUG MARKER: SKIP: sanity test_56aa needs >= 2 MDTs [ 2251.235172] Lustre: DEBUG MARKER: == sanity test 56ab: lfs find --blocks =============================================================== 01:06:35 (1544749595) [ 2253.374241] Lustre: DEBUG MARKER: == sanity test 56ba: test lfs find --component-end, -start, -count, and -flags ======================= 01:06:38 (1544749598) [ 2255.520594] Lustre: DEBUG MARKER: == sanity test 56ca: check lfs find --mirror-count|-N and --mirror-state ============================= 01:06:40 (1544749600) [ 2259.522851] Lustre: DEBUG MARKER: == sanity test 57a: verify MDS filesystem created with large inodes ================================== 01:06:44 (1544749604) [ 2261.654760] Lustre: DEBUG MARKER: == sanity test 57b: default LOV EAs are stored inside large inodes =================================== 01:06:46 (1544749606) [ 2266.053082] Lustre: DEBUG MARKER: == sanity test 58: verify cross-platform wire constants ============================================== 01:06:50 (1544749610) [ 2267.288402] Lustre: DEBUG MARKER: == sanity test 59: verify cancellation of llog records async ========================================= 01:06:51 (1544749611) [ 2277.177475] Lustre: DEBUG MARKER: == sanity test 60a: llog_test run from kernel module and test llog_reader ============================ 01:07:01 (1544749621) [ 2277.599266] Lustre: DEBUG MARKER: test_60 run 30200 - from kernel mode [ 2315.299619] Lustre: DEBUG MARKER: == sanity test 60aa: llog_print works with FIDs and simple names ===================================== 01:07:39 (1544749659) [ 2317.396592] Lustre: DEBUG MARKER: == sanity test 60ab: llog_print params output values from set_param -P =============================== 01:07:42 (1544749662) [ 2317.701630] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 2317.703323] Lustre: lustre-MDT0000-mdc-ffffa124fb682000: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 2317.706985] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9efea2f828 to 0xad93bf9effe9f029 [ 2317.709883] Lustre: MGC10.9.6.154@tcp: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 2317.710836] Lustre: Skipped 1 previous similar message [ 2319.485862] Lustre: DEBUG MARKER: == sanity test 60b: limit repeated messages from CERROR/CWARN ======================================== 01:07:44 (1544749664) [ 2320.894638] Lustre: DEBUG MARKER: == sanity test 60c: unlink file when mds full ======================================================== 01:07:45 (1544749665) [ 2342.201822] Lustre: DEBUG MARKER: == sanity test 60d: test printk console message masking ============================================== 01:08:06 (1544749686) [ 2342.219602] Lustre: DEBUG MARKER: test message ID 13149 26799 [ 2343.453347] Lustre: DEBUG MARKER: == sanity test 60e: no space while new llog is being created ========================================= 01:08:08 (1544749688) [ 2344.923802] Lustre: DEBUG MARKER: == sanity test 60g: transaction abort won't cause MDT hung =========================================== 01:08:09 (1544749689) [ 2364.155031] Lustre: DEBUG MARKER: == sanity test 61: mmap() writes don't make sync hang ================================================ 01:08:28 (1544749708) [ 2365.600105] Lustre: DEBUG MARKER: == sanity test 63a: Verify oig_wait interruption does not crash ====================================== 01:08:30 (1544749710) [ 2428.820484] Lustre: DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync =================================== 01:09:33 (1544749773) [ 2429.201101] Lustre: *** cfs_fail_loc=406, val=0*** [ 2429.201754] LustreError: 14327:0:(osc_request.c:2273:osc_build_rpc()) prep_req failed: -12 [ 2429.202705] LustreError: 14327:0:(osc_cache.c:2291:osc_check_rpcs()) Write request failed with -12 [ 2434.506265] Lustre: DEBUG MARKER: == sanity test 64a: verify filter grant calculations (in kernel) ===================================== 01:09:39 (1544749779) [ 2437.381975] Lustre: DEBUG MARKER: SKIP: sanity test_64b skipping SLOW test 64b [ 2437.654875] Lustre: DEBUG MARKER: == sanity test 64c: verify grant shrink ============================================================== 01:09:42 (1544749782) [ 2440.444563] Lustre: DEBUG MARKER: == sanity test 64d: check grant limit exceed ========================================================= 01:09:45 (1544749785) [ 2491.067561] Lustre: DEBUG MARKER: == sanity test 65a: directory with no stripe info ==================================================== 01:10:35 (1544749835) [ 2492.319286] Lustre: DEBUG MARKER: == sanity test 65b: directory setstripe -S stripe_size*2 -i 0 -c 1 =================================== 01:10:36 (1544749836) [ 2493.588828] Lustre: DEBUG MARKER: == sanity test 65c: directory setstripe -S stripe_size*4 -i 1 -c 0 =================================== 01:10:38 (1544749838) [ 2493.847207] Lustre: DEBUG MARKER: SKIP: sanity test_65c need at least 2 OSTs [ 2494.140521] Lustre: DEBUG MARKER: == sanity test 65d: directory setstripe -S stripe_size -c stripe_count =============================== 01:10:38 (1544749838) [ 2495.402791] Lustre: DEBUG MARKER: == sanity test 65e: directory setstripe defaults ===================================================== 01:10:40 (1544749840) [ 2496.647251] Lustre: DEBUG MARKER: == sanity test 65f: dir setstripe permission (should return error) =================================== 01:10:41 (1544749841) [ 2497.901286] Lustre: DEBUG MARKER: == sanity test 65g: directory setstripe -d =========================================================== 01:10:42 (1544749842) [ 2499.153885] Lustre: DEBUG MARKER: == sanity test 65h: directory stripe info inherit ==================================================== 01:10:43 (1544749843) [ 2500.432560] Lustre: DEBUG MARKER: == sanity test 65i: various tests to set root directory striping ===================================== 01:10:45 (1544749845) [ 2504.194684] Lustre: DEBUG MARKER: == sanity test 65j: set default striping on root directory (bug 6367)================================= 01:10:48 (1544749848) [ 2506.688728] Lustre: DEBUG MARKER: == sanity test 65k: validate manual striping works properly with deactivated OSCs ==================== 01:10:51 (1544749851) [ 2506.946887] Lustre: DEBUG MARKER: SKIP: sanity test_65k needs >= 2 OSTs [ 2507.231333] Lustre: DEBUG MARKER: == sanity test 65l: lfs find on -1 stripe dir ======================================================== 01:10:51 (1544749851) [ 2508.510145] Lustre: DEBUG MARKER: == sanity test 65m: normal user can't set filesystem default stripe ================================== 01:10:53 (1544749853) [ 2509.773097] Lustre: DEBUG MARKER: == sanity test 66: update inode blocks count on client =============================================== 01:10:54 (1544749854) [ 2512.851788] Lustre: DEBUG MARKER: == sanity test 69: verify oa2dentry return -ENOENT doesn't LBUG ====================================== 01:10:57 (1544749857) [ 2516.124132] Lustre: DEBUG MARKER: SKIP: sanity test_71 skipping SLOW test 71 [ 2516.395392] Lustre: DEBUG MARKER: == sanity test 72a: Test that remove suid works properly (bug5695) =================================== 01:11:01 (1544749861) [ 2517.821847] Lustre: DEBUG MARKER: == sanity test 72b: Test that we keep mode setting if without file data changed (bug 24226) ========== 01:11:02 (1544749862) [ 2519.337307] Lustre: DEBUG MARKER: == sanity test 73: multiple MDC requests (should not deadlock) ======================================= 01:11:03 (1544749863) [ 2546.594557] Lustre: DEBUG MARKER: == sanity test 74a: ldlm_enqueue freed-export error path, ls (shouldn't LBUG) ======================== 01:11:31 (1544749891) [ 2547.825832] Lustre: DEBUG MARKER: == sanity test 74b: ldlm_enqueue freed-export error path, touch (shouldn't LBUG) ===================== 01:11:32 (1544749892) [ 2549.049174] Lustre: DEBUG MARKER: == sanity test 74c: ldlm_lock_create error path, (shouldn't LBUG) ==================================== 01:11:33 (1544749893) [ 2549.060714] Lustre: *** cfs_fail_loc=319, val=0*** [ 2550.267902] Lustre: DEBUG MARKER: == sanity test 76: confirm clients recycle inodes properly =========================================== 01:11:34 (1544749894) [ 2552.361777] Lustre: DEBUG MARKER: == sanity test 77a: normal checksum read/write operation ============================================= 01:11:37 (1544749897) [ 2553.977379] Lustre: DEBUG MARKER: == sanity test 77b: checksum error on client write, read ============================================= 01:11:38 (1544749898) [ 2554.094717] Lustre: *** cfs_fail_loc=409, val=0*** [ 2554.282719] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed on the client after we checksummed it - likely false positive due to mmap IO (bug 11742): from 10.9.6.155@tcp inode [0x20000c751:0xdb3c:0x0] object 0x0:504840 extent [0-4194303], original client csum 1d611f27 (type 4), server csum 1d611f26 (type 4), client csum now 1d611f26 [ 2554.286098] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a952b900 x1619785387457760/t47244748190(47244748190) o4->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/416 e 0 to 0 dl 1544749943 ref 3 fl Interpret:R/4/0 rc 0/0 [ 2555.762138] Lustre: DEBUG MARKER: set checksum type to crc32 [ 2555.949955] Lustre: *** cfs_fail_loc=408, val=0*** [ 2555.953980] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb3c:0x0] object 0x0:504840 extent [0-4194303], client be4259aa, server dc51d560, cksum_type 1 [ 2555.956022] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a952a700 x1619785387457936/t0(0) o3->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/408 e 0 to 0 dl 1544749945 ref 2 fl Interpret:RM/0/0 rc 4194304/4194304 [ 2557.573380] Lustre: DEBUG MARKER: set checksum type to adler [ 2557.703889] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb3c:0x0] object 0x0:504840 extent [0-4194303], client 38baf398, server ff30f456, cksum_type 2 [ 2557.705965] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a9528300 x1619785387458096/t0(0) o3->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/408 e 0 to 0 dl 1544749947 ref 2 fl Interpret:RM/0/0 rc 4194304/4194304 [ 2559.317737] Lustre: DEBUG MARKER: set checksum type to crc32c [ 2559.447503] Lustre: *** cfs_fail_loc=408, val=0*** [ 2559.448113] Lustre: Skipped 1 previous similar message [ 2559.450962] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb3c:0x0] object 0x0:504840 extent [0-4194303], client 9a591ed6, server 1d611f26, cksum_type 4 [ 2561.032529] Lustre: DEBUG MARKER: set checksum type to t10ip512 [ 2561.161440] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a952b900 x1619785387458416/t0(0) o3->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/408 e 0 to 0 dl 1544749950 ref 2 fl Interpret:RM/0/0 rc 4194304/4194304 [ 2561.164157] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 1 previous similar message [ 2562.772595] Lustre: DEBUG MARKER: set checksum type to t10ip4K [ 2562.896131] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb3c:0x0] object 0x0:504840 extent [0-4194303], client ea19fd85, server f1cdfdc6, cksum_type 20 [ 2562.898391] LustreError: Skipped 1 previous similar message [ 2564.489306] Lustre: DEBUG MARKER: set checksum type to t10crc512 [ 2564.616405] Lustre: *** cfs_fail_loc=408, val=0*** [ 2564.617042] Lustre: Skipped 2 previous similar messages [ 2566.218759] Lustre: DEBUG MARKER: set checksum type to t10crc4K [ 2566.342167] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a9198000 x1619785387458896/t0(0) o3->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/408 e 0 to 0 dl 1544749956 ref 2 fl Interpret:RM/0/0 rc 4194304/4194304 [ 2566.344888] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 2 previous similar messages [ 2567.882695] Lustre: DEBUG MARKER: set checksum type to crc32c [ 2569.145652] Lustre: DEBUG MARKER: == sanity test 77c: checksum error on client read with debug ========================================= 01:11:53 (1544749913) [ 2570.372409] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb3d:0x0] object 0x0:504841 extent [0-1048575], client 4d633ef0, server 117d28f4, cksum_type 4 [ 2570.374609] LustreError: Skipped 2 previous similar messages [ 2577.789354] Lustre: DEBUG MARKER: == sanity test 77d: checksum error on OST direct write, read ========================================= 01:12:02 (1544749922) [ 2577.877732] Lustre: *** cfs_fail_loc=409, val=0*** [ 2577.878315] Lustre: Skipped 2 previous similar messages [ 2578.173356] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed on the client after we checksummed it - likely false positive due to mmap IO (bug 11742): from 10.9.6.155@tcp inode [0x20000c751:0xdb3f:0x0] object 0x0:504842 extent [0-4194303], original client csum de2bf73f (type 4), server csum de2bf73e (type 4), client csum now de2bf73e [ 2578.176804] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a952b900 x1619785387459648/t47244748298(47244748298) o4->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/416 e 0 to 0 dl 1544749967 ref 2 fl Interpret:RM/0/0 rc 0/0 [ 2578.179519] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 1 previous similar message [ 2579.607315] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb3f:0x0] object 0x0:504842 extent [0-4194303], client f5a99216, server de2bf73e, cksum_type 4 [ 2582.005958] Lustre: DEBUG MARKER: == sanity test 77f: repeat checksum error on write (expect error) ==================================== 01:12:06 (1544749926) [ 2582.274312] Lustre: DEBUG MARKER: set checksum type to crc32 [ 2582.704461] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [0-4194303], original client csum 8b19b060 (type 1), server csum 8b19b05f (type 1), client csum now 8b19b060 [ 2586.584454] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [4194304-8388607], original client csum 8b19b060 (type 1), server csum 8b19b05f (type 1), client csum now 8b19b060 [ 2586.587434] LustreError: Skipped 3 previous similar messages [ 2594.062337] Lustre: *** cfs_fail_loc=409, val=0*** [ 2594.062949] Lustre: Skipped 19 previous similar messages [ 2594.063568] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [4194304-8388607], original client csum 8b19b060 (type 1), server csum 8b19b05f (type 1), client csum now 8b19b060 [ 2594.066511] LustreError: Skipped 3 previous similar messages [ 2599.522783] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a952b000 x1619785387460160/t47244748311(47244748311) o4->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/416 e 0 to 0 dl 1544749988 ref 2 fl Interpret:RM/0/0 rc 0/0 [ 2599.525618] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 11 previous similar messages [ 2606.043226] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [4194304-8388607], original client csum 8b19b060 (type 1), server csum 8b19b05f (type 1), client csum now 8b19b060 [ 2606.046270] LustreError: Skipped 3 previous similar messages [ 2622.202886] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [0-4194303], original client csum 8b19b060 (type 1), server csum 8b19b05f (type 1), client csum now 8b19b060 [ 2622.206015] LustreError: Skipped 3 previous similar messages [ 2631.608626] Lustre: *** cfs_fail_loc=409, val=0*** [ 2631.609280] Lustre: Skipped 19 previous similar messages [ 2631.609857] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a952a100 x1619785387460320/t47244748319(47244748319) o4->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/416 e 0 to 0 dl 1544750021 ref 2 fl Interpret:RM/0/0 rc 0/0 [ 2631.612591] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 7 previous similar messages [ 2642.027792] LustreError: 24909:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2642.354472] Lustre: DEBUG MARKER: set checksum type to adler [ 2654.670841] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [4194304-8388607], original client csum 7d33b9a0 (type 2), server csum 7d33b99f (type 2), client csum now 7d33b9a0 [ 2654.674055] LustreError: Skipped 13 previous similar messages [ 2703.458303] Lustre: *** cfs_fail_loc=409, val=0*** [ 2703.458934] Lustre: Skipped 47 previous similar messages [ 2703.459528] LustreError: 24909:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2703.461261] LustreError: 24909:0:(osc_request.c:2049:brw_interpret()) Skipped 1 previous similar message [ 2703.784332] Lustre: DEBUG MARKER: set checksum type to crc32c [ 2704.280245] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a9199800 x1619785387461040/t47244748345(47244748345) o4->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/416 e 0 to 0 dl 1544750093 ref 2 fl Interpret:RM/0/0 rc 0/0 [ 2704.283077] LustreError: 24908:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 21 previous similar messages [ 2721.677684] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [0-4194303], original client csum de2bf73f (type 4), server csum de2bf73e (type 4), client csum now de2bf73f [ 2721.680586] LustreError: Skipped 23 previous similar messages [ 2763.091585] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2763.093190] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) Skipped 1 previous similar message [ 2763.479083] Lustre: DEBUG MARKER: set checksum type to t10ip512 [ 2822.880777] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2822.882431] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) Skipped 2 previous similar messages [ 2823.193077] Lustre: DEBUG MARKER: set checksum type to t10ip4K [ 2835.490568] Lustre: *** cfs_fail_loc=409, val=0*** [ 2835.491258] Lustre: Skipped 107 previous similar messages [ 2835.491916] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -11 req@ffffa124a919bc00 x1619785387462272/t47244748397(47244748397) o4->lustre-OST0000-osc-ffffa124fb682000@10.9.6.155@tcp:6/4 lens 488/416 e 0 to 0 dl 1544750225 ref 2 fl Interpret:RM/0/0 rc 0/0 [ 2835.494702] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 47 previous similar messages [ 2854.339983] LustreError: 132-0: lustre-OST0000-osc-ffffa124fb682000: BAD WRITE CHECKSUM: changed in transit before arrival at OST: from 10.9.6.155@tcp inode [0x20000c751:0xdb41:0x0] object 0x0:504843 extent [0-4194303], original client csum fec05011 (type 20), server csum fec05010 (type 20), client csum now fec05011 [ 2854.342859] LustreError: Skipped 47 previous similar messages [ 2882.573784] LustreError: 24909:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2882.895766] Lustre: DEBUG MARKER: set checksum type to t10crc512 [ 2940.132808] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2940.134406] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) Skipped 1 previous similar message [ 2940.455143] Lustre: DEBUG MARKER: set checksum type to t10crc4K [ 2998.460924] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa124fb682000: too many resent retries for object: 0:504843, rc = -11. [ 2998.462603] LustreError: 24908:0:(osc_request.c:2049:brw_interpret()) Skipped 1 previous similar message [ 2998.785310] Lustre: DEBUG MARKER: set checksum type to crc32c [ 3000.016125] Lustre: DEBUG MARKER: == sanity test 77g: checksum error on OST write, read ================================================ 01:19:04 (1544750344) [ 3002.258861] LustreError: 133-1: lustre-OST0000-osc-ffffa124fb682000: BAD READ CHECKSUM: from 10.9.6.155@tcp inode [0x20000c751:0xdb43:0x0] object 0x0:504844 extent [0-4194303], client 1d611f26, server b0421b7c, cksum_type 4 [ 3004.934622] Lustre: DEBUG MARKER: SKIP: sanity test_77k skipping ALWAYS excluded test 77k [ 3005.208004] Lustre: DEBUG MARKER: == sanity test 78: handle large O_DIRECT writes correctly ============================================ 01:19:09 (1544750349) [ 3008.831876] Lustre: DEBUG MARKER: == sanity test 79: df report consistency check ======================================================= 01:19:13 (1544750353) [ 3022.529515] Lustre: DEBUG MARKER: == sanity test 80: Page eviction is equally fast at high offsets too ================================ 01:19:27 (1544750367) [ 3025.338083] Lustre: DEBUG MARKER: == sanity test 81a: OST should retry write when get -ENOSPC ========================================== 01:19:30 (1544750370) [ 3027.018727] Lustre: DEBUG MARKER: == sanity test 81b: OST should return -ENOSPC when retry still fails ================================= 01:19:31 (1544750371) [ 3028.659191] Lustre: DEBUG MARKER: == sanity test 82: Basic grouplock test ============================================================== 01:19:33 (1544750373) [ 3032.766264] Lustre: DEBUG MARKER: == sanity test 83: Short write in ptask ============================================================== 01:19:37 (1544750377) [ 3034.337974] Lustre: DEBUG MARKER: == sanity test 99: cvs strange file/directory operations ============================================= 01:19:39 (1544750379) [ 3038.459562] Lustre: DEBUG MARKER: == sanity test 100: check local port using privileged port =========================================== 01:19:43 (1544750383) [ 3040.140055] Lustre: DEBUG MARKER: == sanity test 101a: check read-ahead for random reads =============================================== 01:19:44 (1544750384) [ 3081.753818] Lustre: DEBUG MARKER: == sanity test 101b: check stride-io mode read-ahead ================================================= 01:20:26 (1544750426) [ 3082.010214] Lustre: DEBUG MARKER: SKIP: sanity test_101b needs >= 2 OSTs [ 3082.293960] Lustre: DEBUG MARKER: == sanity test 101c: check stripe_size aligned read-ahead ============================================ 01:20:26 (1544750426) [ 3098.203494] Lustre: DEBUG MARKER: == sanity test 101d: file read with and without read-ahead enabled =================================== 01:20:42 (1544750442) [ 3272.380191] Lustre: DEBUG MARKER: == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ======================= 01:23:37 (1544750617) [ 3286.269497] Lustre: DEBUG MARKER: == sanity test 101f: check mmap read performance ===================================================== 01:23:50 (1544750630) [ 3293.956061] Lustre: DEBUG MARKER: == sanity test 101g: Big bulk(4/16 MiB) readahead ==================================================== 01:23:58 (1544750638) [ 3295.852468] Lustre: Unmounted lustre-client [ 3295.932054] Lustre: Mounted lustre-client [ 3311.245622] Lustre: Unmounted lustre-client [ 3311.312015] Lustre: Mounted lustre-client [ 3312.567059] Lustre: DEBUG MARKER: == sanity test 102a: user xattr test ================================================================= 01:24:17 (1544750657) [ 3314.176497] Lustre: DEBUG MARKER: == sanity test 102b: getfattr/setfattr for trusted.lov EAs =========================================== 01:24:18 (1544750658) [ 3314.430072] Lustre: DEBUG MARKER: SKIP: sanity test_102b needs >= 2 OSTs [ 3314.707961] Lustre: DEBUG MARKER: == sanity test 102c: non-root getfattr/setfattr for lustre.lov EAs =================================== 01:24:19 (1544750659) [ 3314.963200] Lustre: DEBUG MARKER: SKIP: sanity test_102c needs >= 2 OSTs [ 3315.240761] Lustre: DEBUG MARKER: == sanity test 102d: tar restore stripe info from tarfile,not keep osts ============================== 01:24:19 (1544750659) [ 3315.492835] Lustre: DEBUG MARKER: SKIP: sanity test_102d needs >= 2 OSTs [ 3315.769474] Lustre: DEBUG MARKER: == sanity test 102f: tar copy files, not keep osts =================================================== 01:24:20 (1544750660) [ 3316.019899] Lustre: DEBUG MARKER: SKIP: sanity test_102f needs >= 2 OSTs [ 3316.300318] Lustre: DEBUG MARKER: == sanity test 102h: grow xattr from inside inode to external block ================================== 01:24:20 (1544750660) [ 3316.567735] Lustre: DEBUG MARKER: save trusted.big on /mnt/lustre/f102h.sanity [ 3316.828345] Lustre: DEBUG MARKER: save trusted.sml on /mnt/lustre/f102h.sanity [ 3317.093060] Lustre: DEBUG MARKER: grow trusted.sml on /mnt/lustre/f102h.sanity [ 3317.354539] Lustre: DEBUG MARKER: trusted.big still valid after growing trusted.sml [ 3318.569274] Lustre: DEBUG MARKER: == sanity test 102ha: grow xattr from inside inode to external inode ================================= 01:24:23 (1544750663) [ 3319.054285] Lustre: DEBUG MARKER: SKIP: sanity test_102ha ea_inode feature disabled [ 3319.333358] Lustre: DEBUG MARKER: == sanity test 102i: lgetxattr test on symbolic link ================================================= 01:24:24 (1544750664) [ 3320.554607] Lustre: DEBUG MARKER: == sanity test 102j: non-root tar restore stripe info from tarfile, not keep osts ==================== 01:24:25 (1544750665) [ 3320.804800] Lustre: DEBUG MARKER: SKIP: sanity test_102j needs >= 2 OSTs [ 3321.080463] Lustre: DEBUG MARKER: == sanity test 102k: setfattr without parameter of value shouldn't cause a crash ===================== 01:24:25 (1544750665) [ 3322.346842] Lustre: DEBUG MARKER: == sanity test 102l: listxattr size test ============================================================= 01:24:27 (1544750667) [ 3323.562858] Lustre: DEBUG MARKER: == sanity test 102m: Ensure listxattr fails on small bufffer ========================================= 01:24:28 (1544750668) [ 3324.815979] Lustre: DEBUG MARKER: == sanity test 102n: silently ignore setxattr on internal trusted xattrs ============================= 01:24:29 (1544750669) [ 3326.666341] Lustre: DEBUG MARKER: == sanity test 102p: check setxattr(2) correctly fails without permission ============================ 01:24:31 (1544750671) [ 3328.076131] Lustre: DEBUG MARKER: == sanity test 102q: flistxattr should not return trusted.link EAs for orphans ======================= 01:24:32 (1544750672) [ 3329.521597] Lustre: DEBUG MARKER: == sanity test 102r: set EAs with empty values ======================================================= 01:24:34 (1544750674) [ 3330.969791] Lustre: DEBUG MARKER: == sanity test 102s: getting nonexistent xattrs should fail ========================================== 01:24:35 (1544750675) [ 3331.185003] LustreError: 11-0: lustre-MDT0000-mdc-ffffa1249ad25000: operation mds_getxattr to node 10.9.6.154@tcp failed: rc = -95 [ 3332.413671] Lustre: DEBUG MARKER: == sanity test 102t: zero length xattr values handled correctly ====================================== 01:24:37 (1544750677) [ 3333.890312] Lustre: DEBUG MARKER: == sanity test 103a: acl test ======================================================================== 01:24:38 (1544750678) [ 3344.753940] Lustre: DEBUG MARKER: == sanity test 103b: umask lfs setstripe ============================================================= 01:24:49 (1544750689) [ 3358.915028] Lustre: DEBUG MARKER: == sanity test 103c: 'cp -rp' won't set empty acl ==================================================== 01:25:03 (1544750703) [ 3360.298581] Lustre: DEBUG MARKER: == sanity test 104a: lfs df [-ih] [path] test ======================================================== 01:25:04 (1544750704) [ 3360.332834] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 3360.356239] Lustre: lustre-OST0000-osc-ffffa1249ad25000: Connection to lustre-OST0000 (at 10.9.6.155@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 3360.360670] LustreError: 167-0: lustre-OST0000-osc-ffffa1249ad25000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 3360.362606] Lustre: lustre-OST0000-osc-ffffa1249ad25000: Connection restored to 10.9.6.155@tcp (at 10.9.6.155@tcp) [ 3360.363697] Lustre: Skipped 1 previous similar message [ 3360.718016] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing wait_import_state FULL osc.lustre-OST0000-osc-ffffa1249ad25000.ost_server_uuid 200 [ 3360.956128] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffffa1249ad25000.ost_server_uuid in FULL state after 0 sec [ 3362.177072] Lustre: DEBUG MARKER: == sanity test 104b: runas -u 500 -g 500 lfs check servers test ====================================== 01:25:06 (1544750706) [ 3363.380137] Lustre: DEBUG MARKER: == sanity test 105a: flock when mounted without -o flock test ======================================== 01:25:08 (1544750708) [ 3364.620387] Lustre: DEBUG MARKER: == sanity test 105b: fcntl when mounted without -o flock test ======================================== 01:25:09 (1544750709) [ 3365.950756] Lustre: DEBUG MARKER: == sanity test 105c: lockf when mounted without -o flock test ======================================== 01:25:10 (1544750710) [ 3367.167768] Lustre: DEBUG MARKER: == sanity test 105d: flock race (should not freeze) ================================================== 01:25:11 (1544750711) [ 3367.188215] LustreError: 14317:0:(fail.c:129:__cfs_fail_timeout_set()) cfs_fail_timeout id 315 sleeping for 10000ms [ 3377.188782] LustreError: 14317:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 315 awake [ 3378.392860] Lustre: DEBUG MARKER: == sanity test 105e: Two conflicting flocks from same process ======================================== 01:25:23 (1544750723) [ 3379.660200] Lustre: DEBUG MARKER: == sanity test 106: attempt exec of dir followed by chown of that dir ================================ 01:25:24 (1544750724) [ 3380.925684] Lustre: DEBUG MARKER: == sanity test 107: Coredump on SIG ================================================================== 01:25:25 (1544750725) [ 3383.182455] Lustre: DEBUG MARKER: == sanity test 110: filename length checking ========================================================= 01:25:27 (1544750727) [ 3384.468998] Lustre: DEBUG MARKER: SKIP: sanity test_115 skipping SLOW test 115 [ 3384.743147] Lustre: DEBUG MARKER: == sanity test 116a: stripe QOS: free space balance ================================================== 01:25:29 (1544750729) [ 3384.996864] Lustre: DEBUG MARKER: SKIP: sanity test_116a needs >= 2 OSTs [ 3385.283089] Lustre: DEBUG MARKER: == sanity test 116b: QoS shouldn't LBUG if not enough OSTs found on the 2nd pass ===================== 01:25:29 (1544750729) [ 3387.401891] Lustre: DEBUG MARKER: == sanity test 117: verify osd extend ================================================================ 01:25:32 (1544750732) [ 3388.621965] Lustre: DEBUG MARKER: == sanity test 118a: verify O_SYNC works ============================================================= 01:25:33 (1544750733) [ 3390.301033] Lustre: DEBUG MARKER: == sanity test 118b: Reclaim dirty pages on fatal error ============================================== 01:25:34 (1544750734) [ 3392.847687] Lustre: DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ============================= 01:25:37 (1544750737) [ 3394.501458] Lustre: DEBUG MARKER: sanity test_118c: @@@@@@ FAIL: Multiop failed to block on fsync, pid=19086 [ 3406.052247] Lustre: DEBUG MARKER: == sanity test 118d: Fsync validation inject a delay of the bulk ===================================== 01:25:50 (1544750750) [ 3433.896202] Lustre: DEBUG MARKER: == sanity test 118f: Simulate unrecoverable OSC side error =========================================== 01:26:18 (1544750778) [ 3434.047101] Lustre: *** cfs_fail_loc=40a, val=0*** [ 3434.047691] Lustre: Skipped 113 previous similar messages [ 3434.048256] LustreError: 20307:0:(osc_request.c:2273:osc_build_rpc()) prep_req failed: -22 [ 3434.049144] LustreError: 20307:0:(osc_cache.c:2291:osc_check_rpcs()) Write request failed with -22 [ 3435.733596] Lustre: DEBUG MARKER: == sanity test 118g: Don't stay in wait if we got local -ENOMEM ===================================== 01:26:20 (1544750780) [ 3435.893064] LustreError: 20773:0:(osc_request.c:2273:osc_build_rpc()) prep_req failed: -12 [ 3435.894019] LustreError: 20773:0:(osc_cache.c:2291:osc_check_rpcs()) Write request failed with -12 [ 3437.591846] Lustre: DEBUG MARKER: == sanity test 118h: Verify timeout in handling recoverables errors ================================= 01:26:22 (1544750782) [ 3438.117872] LustreError: 11-0: lustre-OST0000-osc-ffffa1249ad25000: operation ost_write to node 10.9.6.155@tcp failed: rc = -5 [ 3438.119164] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) @@@ redo for recoverable error -5 req@ffffa1249839c000 x1619785392372320/t0(0) o4->lustre-OST0000-osc-ffffa1249ad25000@10.9.6.155@tcp:6/4 lens 4584/192 e 0 to 0 dl 1544750827 ref 2 fl Interpret:RM/0/0 rc -5/-5 [ 3438.121688] LustreError: 24909:0:(osc_request.c:1924:osc_brw_redo_request()) Skipped 53 previous similar messages [ 3439.122756] LustreError: 11-0: lustre-OST0000-osc-ffffa1249ad25000: operation ost_write to node 10.9.6.155@tcp failed: rc = -5 [ 3441.124885] LustreError: 11-0: lustre-OST0000-osc-ffffa1249ad25000: operation ost_write to node 10.9.6.155@tcp failed: rc = -5 [ 3448.127626] LustreError: 11-0: lustre-OST0000-osc-ffffa1249ad25000: operation ost_write to node 10.9.6.155@tcp failed: rc = -5 [ 3448.129021] LustreError: Skipped 1 previous similar message [ 3448.129597] LustreError: 24909:0:(osc_request.c:2049:brw_interpret()) lustre-OST0000-osc-ffffa1249ad25000: too many resent retries for object: 0:508156, rc = -5. [ 3448.131066] LustreError: 24909:0:(osc_request.c:2049:brw_interpret()) Skipped 1 previous similar message [ 3448.132067] Lustre: 24909:0:(llite_lib.c:2729:ll_dirty_page_discard_warn()) lustre: dirty page discard: 10.9.6.154@tcp:/lustre/fid: [0x20000cf22:0xae6:0x0]// may get corrupted (rc -5) [ 3449.965772] Lustre: DEBUG MARKER: == sanity test 118i: Fix error before timeout in recoverable error ================================== 01:26:34 (1544750794) [ 3458.002897] Lustre: DEBUG MARKER: == sanity test 118j: Simulate unrecoverable OST side error =========================================== 01:26:42 (1544750802) [ 3458.398478] LustreError: 11-0: lustre-OST0000-osc-ffffa1249ad25000: operation ost_write to node 10.9.6.155@tcp failed: rc = -14 [ 3458.399779] LustreError: Skipped 3 previous similar messages [ 3460.070978] Lustre: DEBUG MARKER: == sanity test 118k: bio alloc -ENOMEM and IO TERM handling ========================================== 01:26:44 (1544750804) [ 3472.313362] Lustre: DEBUG MARKER: == sanity test 118l: fsync dir ======================================================================= 01:26:56 (1544750816) [ 3473.584547] Lustre: DEBUG MARKER: == sanity test 118m: fdatasync dir =================================================================== 01:26:58 (1544750818) [ 3474.887622] Lustre: DEBUG MARKER: == sanity test 118n: statfs() sends OST_STATFS requests in parallel ================================== 01:26:59 (1544750819) [ 3478.608018] Lustre: DEBUG MARKER: == sanity test 119a: Short directIO read must return actual read amount ============================== 01:27:03 (1544750823) [ 3480.323053] Lustre: DEBUG MARKER: == sanity test 119b: Sparse directIO read must return actual read amount ============================= 01:27:05 (1544750825) [ 3480.572252] Lustre: DEBUG MARKER: SKIP: sanity test_119b needs >= 2 OSTs [ 3480.850505] Lustre: DEBUG MARKER: == sanity test 119c: Testing for direct read hitting hole ============================================ 01:27:05 (1544750825) [ 3482.281833] Lustre: DEBUG MARKER: == sanity test 119d: The DIO path should try to send a new rpc once one is completed ================= 01:27:06 (1544750826) [ 3483.780898] Lustre: DEBUG MARKER: the DIO writes have completed, now wait for the reads (should not block very long) [ 3487.024305] Lustre: DEBUG MARKER: == sanity test 120a: Early Lock Cancel: mkdir test =================================================== 01:27:11 (1544750831) [ 3488.650820] Lustre: DEBUG MARKER: == sanity test 120b: Early Lock Cancel: create test ================================================== 01:27:13 (1544750833) [ 3490.263720] Lustre: DEBUG MARKER: == sanity test 120c: Early Lock Cancel: link test ==================================================== 01:27:14 (1544750834) [ 3491.893032] Lustre: DEBUG MARKER: == sanity test 120d: Early Lock Cancel: setattr test ================================================= 01:27:16 (1544750836) [ 3493.537396] Lustre: DEBUG MARKER: == sanity test 120e: Early Lock Cancel: unlink test ================================================== 01:27:18 (1544750838) [ 3502.179766] Lustre: DEBUG MARKER: == sanity test 120f: Early Lock Cancel: rename test ================================================== 01:27:26 (1544750846) [ 3510.847629] Lustre: DEBUG MARKER: == sanity test 120g: Early Lock Cancel: performance test ============================================= 01:27:35 (1544750855) [ 3537.882218] Lustre: DEBUG MARKER: == sanity test 121: read cancel race ================================================================= 01:28:02 (1544750882) [ 3537.909538] Lustre: *** cfs_fail_loc=310, val=0*** [ 3539.129171] Lustre: DEBUG MARKER: == sanity test 123a: verify statahead work =========================================================== 01:28:03 (1544750883) [ 3539.743506] Lustre: DEBUG MARKER: ls 100 files without statahead: 0 sec [ 3540.197139] Lustre: DEBUG MARKER: ls 100 files with statahead: 0 sec [ 3542.729006] Lustre: DEBUG MARKER: ls 1000 files without statahead: 1 sec [ 3543.517813] Lustre: DEBUG MARKER: ls 1000 files with statahead: 1 sec [ 3565.775063] Lustre: DEBUG MARKER: ls 10000 files without statahead: 11 sec [ 3569.858075] Lustre: DEBUG MARKER: ls 10000 files with statahead: 3 sec [ 3570.120387] Lustre: DEBUG MARKER: ls done [ 3577.284050] Lustre: DEBUG MARKER: rm -r /mnt/lustre/d123a.sanity/: 6 seconds [ 3577.560197] Lustre: DEBUG MARKER: rm done [ 3578.803490] Lustre: DEBUG MARKER: == sanity test 123b: not panic with network error in statahead enqueue (bug 15027) =================== 01:28:43 (1544750923) [ 3580.148825] Lustre: *** cfs_fail_loc=803, val=0*** [ 3580.149552] LustreError: 24908:0:(mdc_locks.c:1257:mdc_intent_getattr_async_interpret()) ldlm_cli_enqueue_fini: -110 [ 3581.649487] Lustre: DEBUG MARKER: ls done [ 3583.762628] Lustre: DEBUG MARKER: == sanity test 124a: lru resize ====================================================================== 01:28:48 (1544750928) [ 3584.020205] Lustre: DEBUG MARKER: create 2000 files at /mnt/lustre/d124a.sanity [ 3587.389811] Lustre: DEBUG MARKER: NSDIR=ldlm.namespaces.lustre-MDT0000-mdc-ffffa1249ad25000 [ 3587.643592] Lustre: DEBUG MARKER: NS=ldlm.namespaces.lustre-MDT0000-mdc-ffffa1249ad25000 [ 3587.904758] Lustre: DEBUG MARKER: LRU=2003 [ 3588.159770] Lustre: DEBUG MARKER: LIMIT=91899 [ 3588.413499] Lustre: DEBUG MARKER: LVF=55056 [ 3588.669051] Lustre: DEBUG MARKER: OLD_LVF=1 [ 3588.932255] Lustre: DEBUG MARKER: Sleep 50 sec [ 3639.243044] Lustre: DEBUG MARKER: Dropped 668 locks in 50s [ 3639.503042] Lustre: DEBUG MARKER: unlink 2000 files at /mnt/lustre/d124a.sanity [ 3642.497436] Lustre: DEBUG MARKER: == sanity test 124b: lru resize (performance test) =================================================== 01:29:47 (1544750987) [ 3647.679208] Lustre: DEBUG MARKER: doing ls -la /mnt/lustre/d124b.sanity/disable_lru_resize 3 times [ 3653.064673] Lustre: DEBUG MARKER: ls -la time: 5 seconds [ 3653.318117] Lustre: DEBUG MARKER: lru_size = 200 [ 3663.402501] Lustre: DEBUG MARKER: doing ls -la /mnt/lustre/d124b.sanity/enable_lru_resize 3 times [ 3668.334996] Lustre: DEBUG MARKER: ls -la time: 5 seconds [ 3668.594402] Lustre: DEBUG MARKER: lru_size = 4006 [ 3668.849815] Lustre: DEBUG MARKER: lru resize performs the same with no lru resize [ 3672.944918] Lustre: DEBUG MARKER: == sanity test 124c: LRUR cancel very aged locks ===================================================== 01:30:17 (1544751017) [ 3694.497312] Lustre: DEBUG MARKER: == sanity test 125: don't return EPROTO when a dir has a non-default striping and ACLs =============== 01:30:39 (1544751039) [ 3695.902991] Lustre: DEBUG MARKER: == sanity test 126: check that the fsgid provided by the client is taken into account ================ 01:30:40 (1544751040) [ 3697.136199] Lustre: DEBUG MARKER: == sanity test 127a: verify the client stats are sane ================================================ 01:30:41 (1544751041) [ 3698.473210] Lustre: DEBUG MARKER: == sanity test 127b: verify the llite client stats are sane ========================================== 01:30:43 (1544751043) [ 3699.730269] Lustre: DEBUG MARKER: == sanity test 128: interactive lfs for 2 consecutive find's ========================================= 01:30:44 (1544751044) [ 3700.969903] Lustre: DEBUG MARKER: == sanity test 129: test directory size limit ======================================================== 01:30:45 (1544751045) [ 3744.407328] Lustre: DEBUG MARKER: == sanity test 130a: FIEMAP (1-stripe file) ========================================================== 01:31:29 (1544751089) [ 3745.697037] Lustre: DEBUG MARKER: == sanity test 130b: FIEMAP (1-stripe file) ========================================================== 01:31:30 (1544751090) [ 3745.949428] Lustre: DEBUG MARKER: SKIP: sanity test_130b needs >= 2 OSTs [ 3746.231331] Lustre: DEBUG MARKER: == sanity test 130c: FIEMAP (2-stripe file with hole) ================================================ 01:31:30 (1544751090) [ 3746.482701] Lustre: DEBUG MARKER: SKIP: sanity test_130c needs >= 2 OSTs [ 3746.761753] Lustre: DEBUG MARKER: == sanity test 130d: FIEMAP (N-stripe file) ========================================================== 01:31:31 (1544751091) [ 3747.015116] Lustre: DEBUG MARKER: SKIP: sanity test_130d needs >= 3 OSTs [ 3747.296319] Lustre: DEBUG MARKER: == sanity test 130e: FIEMAP (test continuation FIEMAP calls) ========================================= 01:31:31 (1544751091) [ 3747.547272] Lustre: DEBUG MARKER: SKIP: sanity test_130e needs >= 2 OSTs [ 3747.828621] Lustre: DEBUG MARKER: == sanity test 130f: FIEMAP (unstriped file) ========================================================= 01:31:32 (1544751092) [ 3749.065333] Lustre: DEBUG MARKER: == sanity test 131a: test iov's crossing stripe boundary for writev/readv ============================ 01:31:33 (1544751093) [ 3750.435403] Lustre: DEBUG MARKER: == sanity test 131b: test append writev ============================================================== 01:31:35 (1544751095) [ 3751.784865] Lustre: DEBUG MARKER: == sanity test 131c: test read/write on file w/o objects ============================================= 01:31:36 (1544751096) [ 3753.001942] Lustre: DEBUG MARKER: == sanity test 131d: test short read ================================================================= 01:31:37 (1544751097) [ 3754.277252] Lustre: DEBUG MARKER: == sanity test 131e: test read hitting hole ========================================================== 01:31:38 (1544751098) [ 3755.809111] Lustre: DEBUG MARKER: == sanity test 133a: Verifying MDT stats ============================================================= 01:31:40 (1544751100) [ 3759.363639] Lustre: DEBUG MARKER: == sanity test 133b: Verifying extra MDT stats ======================================================= 01:31:44 (1544751104) [ 3767.207344] Lustre: DEBUG MARKER: == sanity test 133c: Verifying OST stats ============================================================= 01:31:51 (1544751111) [ 3788.649715] Lustre: DEBUG MARKER: == sanity test 133d: Verifying rename_stats ========================================================== 01:32:13 (1544751133) [ 3792.755817] Lustre: DEBUG MARKER: == sanity test 133e: Verifying OST read_bytes write_bytes nid stats ====================================== 01:32:17 (1544751137) [ 3795.156460] Lustre: DEBUG MARKER: == sanity test 133f: Check reads/writes of client lustre proc files with bad area io ================= 01:32:19 (1544751139) [ 3795.732490] LustreError: 20358:0:(ldlm_resource.c:374:lru_size_store()) lru_size: invalid value written [ 3795.821128] Lustre: 20461:0:(libcfs_string.c:129:cfs_str2mask()) unknown mask ''. mask usage: [+|-] ... [ 3795.895963] Lustre: 20492:0:(lprocfs_status.c:2524:lprocfs_wr_nosquash_nids()) lustre: failed to set nosquash_nids to "", bad address rc = -14 [ 3795.897349] Lustre: 20492:0:(lprocfs_status.c:2528:lprocfs_wr_nosquash_nids()) lustre: failed to set nosquash_nids due to string too long rc = -22 [ 3795.899568] Lustre: 20493:0:(lprocfs_status.c:2456:lprocfs_wr_root_squash()) lustre: failed to set root_squash due to bad address, rc = -14 [ 3795.900878] Lustre: 20493:0:(lprocfs_status.c:2452:lprocfs_wr_root_squash()) lustre: failed to set root_squash to "", needs uid:gid format, rc = -22 [ 3797.154342] Lustre: DEBUG MARKER: == sanity test 133g: Check reads/writes of server lustre proc files with bad area io ================= 01:32:21 (1544751141) [ 3825.497372] LustreError: 11-0: lustre-MDT0000-mdc-ffffa1249ad25000: operation ldlm_enqueue to node 10.9.6.154@tcp failed: rc = -107 [ 3825.498759] LustreError: Skipped 24 previous similar messages [ 3825.499376] Lustre: lustre-MDT0000-mdc-ffffa1249ad25000: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 3825.567706] Lustre: lustre-MDT0000-mdc-ffffa1249ad25000: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 3825.923363] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 3826.173756] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 3827.577750] Lustre: Unmounted lustre-client [ 3859.358092] LNet: Removed LNI 10.9.6.156@tcp [ 3859.781923] LNet: HW NUMA nodes: 1, HW CPU cores: 2, npartitions: 2 [ 3859.832288] alg: No test for adler32 (adler32-zlib) [ 3860.687324] Lustre: Lustre: Build Version: 2.12.0_RC2 [ 3860.764159] LNet: Added LNI 10.9.6.156@tcp [8/256/0/180] [ 3860.764848] LNet: Accept secure, port 988 [ 3862.282941] Lustre: 22468:0:(gss_svc_upcall.c:1199:gss_init_svc_upcall()) Init channel is not opened by lsvcgssd, following request might be dropped until lsvcgssd is active [ 3862.284662] Key type lgssc registered [ 3862.420394] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3896.633008] Lustre: Mounted lustre-client [ 3898.305171] Lustre: DEBUG MARKER: Using TIMEOUT=100 [ 3904.741978] Lustre: DEBUG MARKER: == sanity test 133h: Proc files should end with newlines ============================================= 01:34:09 (1544751249) [ 3908.753361] Lustre: DEBUG MARKER: == sanity test 134a: Server reclaims locks when reaching lock_reclaim_threshold ====================== 01:34:13 (1544751253) [ 3923.348965] Lustre: DEBUG MARKER: == sanity test 134b: Server rejects lock request when reaching lock_limit_mb ========================= 01:34:28 (1544751268) [ 3971.765676] Lustre: lustre-OST0000-osc-ffffa1249c720800: disconnect after 44s idle [ 4029.306551] Lustre: DEBUG MARKER: == sanity test 140: Check reasonable stack depth (shouldn't LBUG) ==================================== 01:36:14 (1544751374) [ 4029.324984] Lustre: lustre-OST0000-osc-ffffa1249c720800: reconnect after 58s idle [ 4031.693801] Lustre: DEBUG MARKER: == sanity test 150: truncate/append tests ============================================================ 01:36:16 (1544751376) [ 4032.125771] Lustre: Unmounted lustre-client [ 4032.196995] Lustre: Mounted lustre-client [ 4033.684001] Lustre: DEBUG MARKER: == sanity test 151: test cache on oss and controls =================================================== 01:36:18 (1544751378) [ 4037.850408] Lustre: DEBUG MARKER: == sanity test 152: test read/write with enomem ====================================================== 01:36:22 (1544751382) [ 4039.301052] Lustre: DEBUG MARKER: == sanity test 153: test if fdatasync does not crash ================================================= 01:36:24 (1544751384) [ 4040.755928] Lustre: DEBUG MARKER: == sanity test 154A: lfs path2fid and fid2path basic checks ========================================== 01:36:25 (1544751385) [ 4042.158895] Lustre: DEBUG MARKER: == sanity test 154B: verify the ll_decode_linkea tool ================================================ 01:36:26 (1544751386) [ 4043.582984] Lustre: DEBUG MARKER: == sanity test 154a: Open-by-FID ===================================================================== 01:36:28 (1544751388) [ 4045.653394] Lustre: DEBUG MARKER: == sanity test 154b: Open-by-FID for remote directory ================================================ 01:36:30 (1544751390) [ 4045.900879] Lustre: DEBUG MARKER: SKIP: sanity test_154b needs >= 2 MDTs [ 4046.177491] Lustre: DEBUG MARKER: == sanity test 154c: lfs path2fid and fid2path multiple arguments ==================================== 01:36:30 (1544751390) [ 4047.593564] Lustre: DEBUG MARKER: == sanity test 154d: Verify open file fid ============================================================ 01:36:32 (1544751392) [ 4049.244527] Lustre: DEBUG MARKER: == sanity test 154e: .lustre is not returned by readdir ============================================== 01:36:33 (1544751393) [ 4050.659706] Lustre: DEBUG MARKER: == sanity test 154f: get parent fids by reading link ea ============================================== 01:36:35 (1544751395) [ 4052.040975] Lustre: DEBUG MARKER: == sanity test 154g: various llapi FID tests ========================================================= 01:36:36 (1544751396) [ 4052.363358] brd: module loaded [ 4094.529795] Lustre: DEBUG MARKER: == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ===================== 01:37:19 (1544751439) [ 4096.606278] Lustre: DEBUG MARKER: == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ==================== 01:37:21 (1544751441) [ 4098.669197] Lustre: DEBUG MARKER: == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ==================== 01:37:23 (1544751443) [ 4100.698622] Lustre: DEBUG MARKER: == sanity test 155d: Verify small file correctness: read cache:off write_cache:off =================== 01:37:25 (1544751445) [ 4102.759199] Lustre: DEBUG MARKER: == sanity test 155e: Verify big file correctness: read cache:on write_cache:on ======================= 01:37:27 (1544751447) [ 4111.186095] Lustre: lfs: using old ioctl(LL_IOC_LOV_GETSTRIPE) on [0x20000dec2:0x882:0x0], use llapi_layout_get_by_path() [ 4113.380643] Lustre: DEBUG MARKER: == sanity test 155f: Verify big file correctness: read cache:on write_cache:off ====================== 01:37:38 (1544751458) [ 4124.117656] Lustre: DEBUG MARKER: == sanity test 155g: Verify big file correctness: read cache:off write_cache:on ====================== 01:37:48 (1544751468) [ 4133.634296] Lustre: DEBUG MARKER: == sanity test 155h: Verify big file correctness: read cache:off write_cache:off ===================== 01:37:58 (1544751478) [ 4143.480578] Lustre: DEBUG MARKER: == sanity test 156: Verification of tunables ========================================================= 01:38:08 (1544751488) [ 4144.575321] Lustre: DEBUG MARKER: Turn on read and write cache [ 4145.273729] Lustre: DEBUG MARKER: Write data and read it back. [ 4145.525695] Lustre: DEBUG MARKER: Read should be satisfied from the cache. [ 4146.256844] Lustre: DEBUG MARKER: cache hits:: before: 8228, after: 8231 [ 4146.510146] Lustre: DEBUG MARKER: Read again; it should be satisfied from the cache. [ 4146.999788] Lustre: DEBUG MARKER: cache hits:: before: 8231, after: 8234 [ 4147.258129] Lustre: DEBUG MARKER: Turn off the read cache and turn on the write cache [ 4147.975842] Lustre: DEBUG MARKER: Read again; it should be satisfied from the cache. [ 4148.716361] Lustre: DEBUG MARKER: cache hits:: before: 8234, after: 8237 [ 4148.973670] Lustre: DEBUG MARKER: Read again; it should not be satisfied from the cache. [ 4149.486674] Lustre: DEBUG MARKER: cache hits:: before: 8237, after: 8237 [ 4149.747652] Lustre: DEBUG MARKER: Write data and read it back. [ 4150.008741] Lustre: DEBUG MARKER: Read should be satisfied from the cache. [ 4150.763943] Lustre: DEBUG MARKER: cache hits:: before: 8237, after: 8240 [ 4151.022658] Lustre: DEBUG MARKER: Read again; it should not be satisfied from the cache. [ 4151.534843] Lustre: DEBUG MARKER: cache hits:: before: 8240, after: 8240 [ 4151.796096] Lustre: DEBUG MARKER: Turn off read and write cache [ 4152.524777] Lustre: DEBUG MARKER: Write data and read it back [ 4152.785039] Lustre: DEBUG MARKER: It should not be satisfied from the cache. [ 4153.540299] Lustre: DEBUG MARKER: cache hits:: before: 8240, after: 8240 [ 4153.797608] Lustre: DEBUG MARKER: Turn on the read cache and turn off the write cache [ 4154.525864] Lustre: DEBUG MARKER: Write data and read it back [ 4154.779692] Lustre: DEBUG MARKER: It should not be satisfied from the cache. [ 4155.548107] Lustre: DEBUG MARKER: cache hits:: before: 8240, after: 8240 [ 4155.804389] Lustre: DEBUG MARKER: Read again; it should be satisfied from the cache. [ 4156.527208] Lustre: DEBUG MARKER: cache hits:: before: 8240, after: 8243 [ 4157.925157] Lustre: DEBUG MARKER: == sanity test 160a: changelog sanity ================================================================ 01:38:22 (1544751502) [ 4159.056365] Lustre: DEBUG MARKER: sanity test_160a: @@@@@@ FAIL: User not found in changelog_users [ 4170.837732] Lustre: DEBUG MARKER: == sanity test 160b: Verify that very long rename doesn't crash in changelog ========================= 01:38:35 (1544751515) [ 4171.958703] Lustre: DEBUG MARKER: sanity test_160b: @@@@@@ FAIL: User '' not found in changelog_users [ 4180.632314] Lustre: DEBUG MARKER: == sanity test 160c: verify that changelog log catch the truncate event ============================== 01:38:45 (1544751525) [ 4183.550253] Lustre: DEBUG MARKER: == sanity test 160d: verify that changelog log catch the migrate event =============================== 01:38:48 (1544751528) [ 4183.822793] Lustre: DEBUG MARKER: SKIP: sanity test_160d needs >= 2 MDTs [ 4184.101562] Lustre: DEBUG MARKER: == sanity test 160e: changelog negative testing (should return errors) =============================== 01:38:48 (1544751528) [ 4185.041059] Lustre: DEBUG MARKER: sanity test_160e: @@@@@@ FAIL: changelog_deregister failed with 1, expect 2 (ENOENT) [ 4194.046177] Lustre: DEBUG MARKER: == sanity test 160f: changelog garbage collect (timestamped users) =================================== 01:38:58 (1544751538) [ 4210.945806] Lustre: DEBUG MARKER: == sanity test 160g: changelog garbage collect (old users) =========================================== 01:39:15 (1544751555) [ 4217.870476] Lustre: DEBUG MARKER: sanity test_160g: @@@@@@ FAIL: mds1: first index should be 11 + 1, but is 7 [ 4226.666905] Lustre: DEBUG MARKER: == sanity test 160h: changelog gc thread stop upon umount, orphan records delete ===================== 01:39:31 (1544751571) [ 4252.844113] Lustre: DEBUG MARKER: sanity test_160h: @@@@@@ FAIL: mds1: User cl10 still registered [ 4257.961404] Lustre: lustre-MDT0000-mdc-ffffa124aa583800: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4257.963332] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 4257.965190] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9f0033e030 to 0xad93bf9f003b5c46 [ 4257.966705] Lustre: MGC10.9.6.154@tcp: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 4261.246105] Lustre: DEBUG MARKER: == sanity test 160i: changelog user register/unregister race ========================================= 01:40:05 (1544751605) [ 4267.276882] Lustre: DEBUG MARKER: == sanity test 161a: link ea sanity ================================================================== 01:40:11 (1544751611) [ 4270.992829] Lustre: DEBUG MARKER: == sanity test 161b: link ea sanity under remote directory =========================================== 01:40:15 (1544751615) [ 4271.241172] Lustre: DEBUG MARKER: SKIP: sanity test_161b skipping remote directory test [ 4271.524578] Lustre: DEBUG MARKER: == sanity test 161c: check CL_RENME[UNLINK] changelog record flags =================================== 01:40:16 (1544751616) [ 4275.330561] Lustre: DEBUG MARKER: == sanity test 161d: create with concurrent .lustre/fid access ======================================= 01:40:20 (1544751620) [ 4275.880520] LustreError: 21619:0:(fail.c:129:__cfs_fail_timeout_set()) cfs_fail_timeout id 140c sleeping for 5000ms [ 4280.880935] LustreError: 21619:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 140c awake [ 4282.600305] Lustre: DEBUG MARKER: == sanity test 162a: path lookup sanity ============================================================== 01:40:27 (1544751627) [ 4283.930661] Lustre: DEBUG MARKER: == sanity test 162b: striped directory path lookup sanity ============================================ 01:40:28 (1544751628) [ 4284.178701] Lustre: DEBUG MARKER: SKIP: sanity test_162b needs >= 2 MDTs [ 4284.457857] Lustre: DEBUG MARKER: == sanity test 162c: fid2path works with paths 100 or more directories deep ========================== 01:40:29 (1544751629) [ 4288.061457] Lustre: DEBUG MARKER: == sanity test 169: parallel read and truncate should not deadlock =================================== 01:40:32 (1544751632) [ 4288.311884] Lustre: DEBUG MARKER: creating a 10 Mb file [ 4289.436842] Lustre: DEBUG MARKER: starting reads [ 4289.825981] Lustre: DEBUG MARKER: truncating the file [ 4290.090004] Lustre: DEBUG MARKER: killing dd [ 4290.344162] Lustre: DEBUG MARKER: removing the temporary file [ 4291.587019] Lustre: DEBUG MARKER: == sanity test 170: test lctl df to handle corrupted log ============================================= 01:40:36 (1544751636) [ 4291.601152] Lustre: debug daemon will attempt to start writing to /tmp/f170.sanity_log_good (512000kB max) [ 4291.608336] Lustre: shutting down debug daemon thread... [ 4292.605373] Lustre: debug daemon will attempt to start writing to /tmp/f170.sanity_log_good (512000kB max) [ 4292.611940] Lustre: shutting down debug daemon thread... [ 4294.873334] Lustre: DEBUG MARKER: == sanity test 171: test libcfs_debug_dumplog_thread stuck in do_exit() ============================== 01:40:39 (1544751639) [ 4294.894666] LustreError: 25896:0:(fail.c:129:__cfs_fail_timeout_set()) cfs_fail_timeout id 50e sleeping for 3000ms [ 4297.021153] Lustre: *** cfs_fail_loc=50e, val=0*** [ 4297.022099] LustreError: dumping log to /tmp/lustre-log.1544751641.26533 [ 4297.895191] LustreError: 25896:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 50e awake [ 4297.896323] LustreError: dumping log to /tmp/lustre-log.1544751642.25896 [ 4299.116505] Lustre: DEBUG MARKER: == sanity test 180a: test obdecho on osc ============================================================= 01:40:43 (1544751643) [ 4301.733805] Lustre: DEBUG MARKER: == sanity test 180b: test obdecho directly on obdfilter ============================================== 01:40:46 (1544751646) [ 4305.639225] Lustre: DEBUG MARKER: == sanity test 180c: test huge bulk I/O size on obdfilter, don't LASSERT ============================= 01:40:50 (1544751650) [ 4310.220476] Lustre: DEBUG MARKER: == sanity test 181: Test open-unlinked dir =========================================================== 01:40:54 (1544751654) [ 4330.730968] Lustre: DEBUG MARKER: == sanity test 182: Test parallel modify metadata operations ========================================= 01:41:15 (1544751675) [ 4340.501824] Lustre: DEBUG MARKER: == sanity test 183: No crash or request leak in case of strange dispositions ========================= 01:41:25 (1544751685) [ 4342.417951] Lustre: DEBUG MARKER: == sanity test 184a: Basic layout swap =============================================================== 01:41:27 (1544751687) [ 4344.207014] Lustre: DEBUG MARKER: == sanity test 184b: Forbidden layout swap (will generate errors) ==================================== 01:41:28 (1544751688) [ 4345.523891] Lustre: DEBUG MARKER: == sanity test 184c: Concurrent write and layout swap ================================================ 01:41:30 (1544751690) [ 4351.867577] Lustre: DEBUG MARKER: == sanity test 184d: allow stripeless layouts swap =================================================== 01:41:36 (1544751696) [ 4354.403807] Lustre: DEBUG MARKER: == sanity test 184e: Recreate layout after stripeless layout swaps =================================== 01:41:39 (1544751699) [ 4355.948411] Lustre: DEBUG MARKER: == sanity test 184f: IOC_MDC_GETFILEINFO for files with long names but no striping =================== 01:41:40 (1544751700) [ 4357.174855] Lustre: DEBUG MARKER: == sanity test 185: Volatile file support ============================================================ 01:41:41 (1544751701) [ 4359.618444] Lustre: DEBUG MARKER: == sanity test 187a: Test data version change ======================================================== 01:41:44 (1544751704) [ 4361.992405] Lustre: DEBUG MARKER: == sanity test 187b: Test data version change on volatile file ======================================= 01:41:46 (1544751706) [ 4363.787573] Lustre: DEBUG MARKER: == sanity test 200: OST pools ======================================================================== 01:41:48 (1544751708) [ 4408.469746] Lustre: DEBUG MARKER: == sanity test 204a: Print default stripe attributes ================================================= 01:42:33 (1544751753) [ 4409.739464] Lustre: DEBUG MARKER: == sanity test 204b: Print default stripe size and offset ============================================ 01:42:34 (1544751754) [ 4411.010652] Lustre: DEBUG MARKER: == sanity test 204c: Print default stripe count and offset =========================================== 01:42:35 (1544751755) [ 4412.254839] Lustre: DEBUG MARKER: == sanity test 204d: Print default stripe count and size ============================================= 01:42:36 (1544751756) [ 4413.497269] Lustre: DEBUG MARKER: == sanity test 204e: Print raw stripe attributes ===================================================== 01:42:38 (1544751758) [ 4414.750455] Lustre: DEBUG MARKER: == sanity test 204f: Print raw stripe size and offset ================================================ 01:42:39 (1544751759) [ 4415.998838] Lustre: DEBUG MARKER: == sanity test 204g: Print raw stripe count and offset =============================================== 01:42:40 (1544751760) [ 4417.237497] Lustre: DEBUG MARKER: == sanity test 204h: Print raw stripe count and size ================================================= 01:42:41 (1544751761) [ 4418.482467] Lustre: DEBUG MARKER: == sanity test 205: Verify job stats ================================================================= 01:42:43 (1544751763) [ 4426.112142] Lustre: DEBUG MARKER: Test: mkdir /mnt/lustre/d205.sanity [ 4426.368485] Lustre: DEBUG MARKER: Using JobID environment nodelocal=id.205.mkdir.17229 [ 4426.971328] Lustre: DEBUG MARKER: sanity test_205: @@@@@@ FAIL: No jobstats for id.205.mkdir.17229 found on mds::*..job_stats [ 4439.592918] Lustre: DEBUG MARKER: == sanity test 206: fail lov_init_raid0() doesn't lbug =============================================== 01:43:04 (1544751784) [ 4440.856010] Lustre: DEBUG MARKER: == sanity test 207a: can refresh layout at glimpse =================================================== 01:43:05 (1544751785) [ 4442.094562] Lustre: DEBUG MARKER: == sanity test 207b: can refresh layout at open ====================================================== 01:43:06 (1544751786) [ 4443.364869] Lustre: DEBUG MARKER: == sanity test 208: Exclusive open =================================================================== 01:43:08 (1544751788) [ 4449.697405] Lustre: lustre-MDT0000-mdc-ffffa124aa583800: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4474.785639] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 4474.788218] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9f003b5c46 to 0xad93bf9f0050beee [ 4474.789642] LustreError: 22454:0:(client.c:3023:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffffa124f9a63300 x1619789041373984/t128849064108(128849064108) o101->lustre-MDT0000-mdc-ffffa124aa583800@10.9.6.154@tcp:12/10 lens 568/560 e 0 to 0 dl 1544751862 ref 2 fl Interpret:RP/4/0 rc 301/301 [ 4474.792502] Lustre: MGC10.9.6.154@tcp: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 4474.793556] Lustre: Skipped 1 previous similar message [ 4475.216136] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4475.461608] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 4490.181032] Lustre: 26539:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544751828/real 1544751828] req@ffffa1248ecee400 x1619789041374480/t0(0) o101->MGC10.9.6.154@tcp@10.9.6.154@tcp:26/25 lens 328/344 e 0 to 1 dl 1544751835 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 4490.183946] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 4498.885594] LustreError: 11-0: lustre-MDT0000-mdc-ffffa124aa583800: operation mds_statfs to node 10.9.6.154@tcp failed: rc = -107 [ 4498.886964] Lustre: lustre-MDT0000-mdc-ffffa124aa583800: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4498.893191] LustreError: 22454:0:(client.c:3023:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffffa124f9a63900 x1619789041374416/t133143986179(133143986179) o101->lustre-MDT0000-mdc-ffffa124aa583800@10.9.6.154@tcp:12/10 lens 576/560 e 0 to 0 dl 1544751885 ref 2 fl Interpret:RP/4/0 rc 301/301 [ 4498.895924] LustreError: 22454:0:(client.c:3023:ptlrpc_replay_interpret()) Skipped 1 previous similar message [ 4498.960924] Lustre: lustre-MDT0000-mdc-ffffa124aa583800: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 4498.962014] Lustre: Skipped 1 previous similar message [ 4499.307230] Lustre: DEBUG MARKER: trevis-60vm3.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid [ 4499.554630] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 4501.963571] Lustre: DEBUG MARKER: == sanity test 209: read-only open/close requests should be freed promptly =========================== 01:44:06 (1544751846) [ 4507.402792] bash (10215): drop_caches: 3 [ 4508.603073] bash (10215): drop_caches: 3 [ 4509.912289] Lustre: DEBUG MARKER: == sanity test 212: Sendfile test ==================================================================== 01:44:14 (1544751854) [ 4511.407462] Lustre: DEBUG MARKER: == sanity test 213: OSC lock completion and cancel race don't crash - bug 18829 ====================== 01:44:16 (1544751856) [ 4512.540220] LustreError: 22458:0:(fail.c:129:__cfs_fail_timeout_set()) cfs_fail_timeout id 40f sleeping for 10000ms [ 4512.543210] LustreError: 22458:0:(fail.c:133:__cfs_fail_timeout_set()) cfs_fail_timeout id 40f awake [ 4513.765660] Lustre: DEBUG MARKER: == sanity test 214: hash-indexed directory test - bug 20133 ========================================== 01:44:18 (1544751858) [ 4515.230529] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9f0050beee to 0xad93bf9f00516c7b [ 4515.232299] Lustre: MGC10.9.6.154@tcp: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 4516.491442] Lustre: DEBUG MARKER: == sanity test 215: lnet exists and has proper content - bugs 18102, 21079, 21517 ==================== 01:44:21 (1544751861) [ 4517.794409] Lustre: DEBUG MARKER: == sanity test 216: check lockless direct write updates file size and kms correctly ================== 01:44:22 (1544751862) [ 4520.728613] Lustre: DEBUG MARKER: == sanity test 217: check lctl ping for hostnames with hiphen ('-') ================================== 01:44:25 (1544751865) [ 4522.401960] Lustre: DEBUG MARKER: == sanity test 218: parallel read and truncate should not deadlock =================================== 01:44:27 (1544751867) [ 4522.650655] Lustre: DEBUG MARKER: creating a 10 Mb file [ 4523.595066] Lustre: DEBUG MARKER: starting reads [ 4523.971041] Lustre: DEBUG MARKER: truncating the file [ 4524.231190] Lustre: DEBUG MARKER: killing dd [ 4524.501393] Lustre: DEBUG MARKER: removing the temporary file [ 4525.744376] Lustre: DEBUG MARKER: == sanity test 219: LU-394: Write partial won't cause uncontiguous pages vec at LND ================== 01:44:30 (1544751870) [ 4525.760186] Lustre: *** cfs_fail_loc=411, val=0*** [ 4527.241199] Lustre: DEBUG MARKER: SKIP: sanity test_220 skipping excluded test 220 [ 4527.517788] Lustre: DEBUG MARKER: == sanity test 221: make sure fault and truncate race to not cause OOM =============================== 01:44:32 (1544751872) [ 4532.185005] Lustre: DEBUG MARKER: == sanity test 222a: AGL for ls should not trigger CLIO lock failure ================================= 01:44:36 (1544751876) [ 4533.114180] Lustre: 22457:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1544751835/real 1544751835] req@ffffa1248ecef900 x1619789041374528/t0(0) o400->lustre-MDT0000-mdc-ffffa124aa583800@10.9.6.154@tcp:12/10 lens 224/224 e 0 to 1 dl 1544751878 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 4533.470148] Lustre: DEBUG MARKER: == sanity test 222b: AGL for rmdir should not trigger CLIO lock failure ============================== 01:44:38 (1544751878) [ 4534.759950] Lustre: DEBUG MARKER: == sanity test 223: osc reenqueue if without AGL lock granted ======================================== 01:44:39 (1544751879) [ 4536.046463] Lustre: DEBUG MARKER: == sanity test 224a: Don't panic on bulk IO failure ================================================== 01:44:40 (1544751880) [ 4537.494518] Lustre: DEBUG MARKER: == sanity test 224b: Don't panic on bulk IO failure ================================================== 01:44:42 (1544751882) [ 4538.751336] Lustre: DEBUG MARKER: == sanity test 224c: Don't hang if one of md lost during large bulk RPC ============================== 01:44:43 (1544751883) [ 4557.997664] LustreError: 11-0: lustre-OST0000-osc-ffffa124aa583800: operation ldlm_enqueue to node 10.9.6.155@tcp failed: rc = -107 [ 4557.999042] Lustre: lustre-OST0000-osc-ffffa124aa583800: Connection to lustre-OST0000 (at 10.9.6.155@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4558.001428] LustreError: 167-0: lustre-OST0000-osc-ffffa124aa583800: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4558.003344] Lustre: lustre-OST0000-osc-ffffa124aa583800: Connection restored to 10.9.6.155@tcp (at 10.9.6.155@tcp) [ 4565.404409] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 4565.405975] Lustre: lustre-MDT0000-mdc-ffffa124aa583800: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4565.408392] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9f00516c7b to 0xad93bf9f0051828c [ 4565.409677] LustreError: 167-0: lustre-MDT0000-mdc-ffffa124aa583800: This client was evicted by lustre-MDT0000; in progress operations using this service will fail. [ 4575.293348] Lustre: DEBUG MARKER: SKIP: sanity test_225a skipping excluded test 225a [ 4575.602023] Lustre: DEBUG MARKER: SKIP: sanity test_225b skipping excluded test 225b [ 4575.875617] Lustre: DEBUG MARKER: == sanity test 226a: call path2fid and fid2path on files of all type ================================= 01:45:20 (1544751920) [ 4577.194255] Lustre: DEBUG MARKER: == sanity test 226b: call path2fid and fid2path on files of all type under remote dir ================ 01:45:21 (1544751921) [ 4577.447520] Lustre: DEBUG MARKER: SKIP: sanity test_226b needs >= 2 MDTs [ 4577.730537] Lustre: DEBUG MARKER: == sanity test 227: running truncated executable does not cause OOM ================================== 01:45:22 (1544751922) [ 4578.984650] Lustre: DEBUG MARKER: == sanity test 228a: try to reuse idle OI blocks ===================================================== 01:45:23 (1544751923) [ 4579.046184] Lustre: *** cfs_fail_loc=1002, val=0*** [ 4623.053261] Lustre: DEBUG MARKER: SKIP: sanity test_228b skipping excluded test 228b [ 4623.326552] Lustre: DEBUG MARKER: == sanity test 228c: NOT shrink the last entry in OI index node to recycle idle leaf ================= 01:46:08 (1544751968) [ 4623.382599] Lustre: *** cfs_fail_loc=1002, val=0*** [ 4691.254038] Lustre: DEBUG MARKER: == sanity test 229: getstripe/stat/rm/attr changes work on released files ============================ 01:47:15 (1544752035) [ 4691.504855] Lustre: DEBUG MARKER: SKIP: sanity test_229 needs >= 2 OSTs [ 4691.788269] Lustre: DEBUG MARKER: == sanity test 230a: Create remote directory and files under the remote directory ==================== 01:47:16 (1544752036) [ 4692.039064] Lustre: DEBUG MARKER: SKIP: sanity test_230a needs >= 2 MDTs [ 4692.323931] Lustre: DEBUG MARKER: == sanity test 230b: migrate directory =============================================================== 01:47:17 (1544752037) [ 4692.575761] Lustre: DEBUG MARKER: SKIP: sanity test_230b needs >= 2 MDTs [ 4692.857326] Lustre: DEBUG MARKER: == sanity test 230c: check directory accessiblity if migration failed ================================ 01:47:17 (1544752037) [ 4693.105453] Lustre: DEBUG MARKER: SKIP: sanity test_230c needs >= 2 MDTs [ 4693.386831] Lustre: DEBUG MARKER: == sanity test 230d: check migrate big directory ===================================================== 01:47:18 (1544752038) [ 4693.638312] Lustre: DEBUG MARKER: SKIP: sanity test_230d needs >= 2 MDTs [ 4693.920111] Lustre: DEBUG MARKER: == sanity test 230e: migrate mulitple local link files =============================================== 01:47:18 (1544752038) [ 4694.172453] Lustre: DEBUG MARKER: SKIP: sanity test_230e needs >= 2 MDTs [ 4694.453995] Lustre: DEBUG MARKER: == sanity test 230f: migrate mulitple remote link files ============================================== 01:47:19 (1544752039) [ 4694.707235] Lustre: DEBUG MARKER: SKIP: sanity test_230f needs >= 2 MDTs [ 4694.990944] Lustre: DEBUG MARKER: == sanity test 230g: migrate dir to non-exist MDT ==================================================== 01:47:19 (1544752039) [ 4695.243093] Lustre: DEBUG MARKER: SKIP: sanity test_230g needs >= 2 MDTs [ 4695.525115] Lustre: DEBUG MARKER: == sanity test 230h: migrate .. and root ============================================================= 01:47:20 (1544752040) [ 4695.775682] Lustre: DEBUG MARKER: SKIP: sanity test_230h needs >= 2 MDTs [ 4696.060066] Lustre: DEBUG MARKER: == sanity test 230i: lfs migrate -m tolerates trailing slashes ======================================= 01:47:20 (1544752040) [ 4696.311608] Lustre: DEBUG MARKER: SKIP: sanity test_230i needs >= 2 MDTs [ 4696.594636] Lustre: DEBUG MARKER: == sanity test 230j: DoM file data not changed after dir migration =================================== 01:47:21 (1544752041) [ 4696.849744] Lustre: DEBUG MARKER: SKIP: sanity test_230j needs >= 2 MDTs [ 4697.144484] Lustre: DEBUG MARKER: == sanity test 230k: file data not changed after dir migration ======================================= 01:47:21 (1544752041) [ 4697.400523] Lustre: DEBUG MARKER: SKIP: sanity test_230k needs >= 4 MDTs [ 4697.682860] Lustre: DEBUG MARKER: == sanity test 231a: checking that reading/writing of BRW RPC size results in one RPC ================ 01:47:22 (1544752042) [ 4700.915487] Lustre: DEBUG MARKER: == sanity test 231b: must not assert on fully utilized OST request buffer ============================ 01:47:25 (1544752045) [ 4705.873159] Lustre: DEBUG MARKER: == sanity test 232a: failed lock should not block umount ============================================= 01:47:30 (1544752050) [ 4706.055396] LustreError: 11-0: lustre-OST0000-osc-ffffa124aa583800: operation ldlm_enqueue to node 10.9.6.155@tcp failed: rc = -12 [ 4706.588106] Lustre: Unmounted lustre-client [ 4706.662031] Lustre: Mounted lustre-client [ 4711.847858] Lustre: DEBUG MARKER: == sanity test 232b: failed data version lock should not block umount ================================ 01:47:36 (1544752056) [ 4712.055439] LustreError: 11-0: lustre-OST0000-osc-ffffa12490e7b000: operation ldlm_enqueue to node 10.9.6.155@tcp failed: rc = -107 [ 4712.056816] Lustre: lustre-OST0000-osc-ffffa12490e7b000: Connection to lustre-OST0000 (at 10.9.6.155@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 4712.163681] Lustre: lustre-OST0000-osc-ffffa12490e7b000: Connection restored to 10.9.6.155@tcp (at 10.9.6.155@tcp) [ 4712.164792] Lustre: Skipped 2 previous similar messages [ 4712.877727] Lustre: Unmounted lustre-client [ 4712.950552] Lustre: Mounted lustre-client [ 4718.216859] Lustre: DEBUG MARKER: == sanity test 233a: checking that OBF of the FS root succeeds ======================================= 01:47:42 (1544752062) [ 4719.646542] Lustre: DEBUG MARKER: == sanity test 233b: checking that OBF of the FS .lustre succeeds ==================================== 01:47:44 (1544752064) [ 4721.076462] Lustre: DEBUG MARKER: == sanity test 234: xattr cache should not crash on ENOMEM =========================================== 01:47:45 (1544752065) [ 4721.117608] Lustre: *** cfs_fail_loc=1405, val=0*** [ 4722.370681] Lustre: DEBUG MARKER: == sanity test 235: LU-1715: flock deadlock detection does not work properly ========================= 01:47:47 (1544752067) [ 4725.902197] Lustre: DEBUG MARKER: == sanity test 236: Layout swap on open unlinked file ================================================ 01:47:50 (1544752070) [ 4727.218484] Lustre: DEBUG MARKER: == sanity test 238: Verify linkea consistency ======================================================== 01:47:51 (1544752071) [ 4728.664474] Lustre: DEBUG MARKER: == sanity test 239A: osp_sync test =================================================================== 01:47:53 (1544752073) [ 4748.854729] Lustre: DEBUG MARKER: == sanity test 239a: process invalid osp sync record correctly ======================================= 01:48:13 (1544752093) [ 4757.005075] Lustre: DEBUG MARKER: == sanity test 239b: process osp sync record with ENOMEM error correctly ============================= 01:48:21 (1544752101) [ 4761.246836] Lustre: DEBUG MARKER: == sanity test 240: race between ldlm enqueue and the connection RPC (no ASSERT) ===================== 01:48:25 (1544752105) [ 4761.496380] Lustre: DEBUG MARKER: SKIP: sanity test_240 needs >= 2 MDTs [ 4761.779834] Lustre: DEBUG MARKER: == sanity test 241a: bio vs dio ====================================================================== 01:48:26 (1544752106) [ 4773.512041] Lustre: DEBUG MARKER: == sanity test 241b: dio vs dio ====================================================================== 01:48:38 (1544752118) [ 4780.596009] Lustre: DEBUG MARKER: == sanity test 242: mdt_readpage failure should not cause directory unreadable ======================= 01:48:45 (1544752125) [ 4780.810548] LustreError: 11-0: lustre-MDT0000-mdc-ffffa124a8966000: operation mds_readpage to node 10.9.6.154@tcp failed: rc = -12 [ 4782.208214] Lustre: DEBUG MARKER: == sanity test 243: various group lock tests ========================================================= 01:48:46 (1544752126) [ 4782.746391] Lustre: 10237:0:(file.c:2179:ll_get_grouplock()) group lock already existed with gid 97486 [ 4782.747549] Lustre: 10237:0:(file.c:2248:ll_put_grouplock()) no group lock held [ 4782.748434] Lustre: 10237:0:(file.c:2169:ll_get_grouplock()) group id for group lock must not be 0 [ 4782.749821] Lustre: 10237:0:(file.c:2256:ll_put_grouplock()) group lock 4294967286 doesn't match current id 3543 [ 4796.011341] Lustre: 10237:0:(file.c:2248:ll_put_grouplock()) no group lock held [ 4796.032263] Lustre: 10237:0:(file.c:2169:ll_get_grouplock()) group id for group lock must not be 0 [ 4797.299383] Lustre: DEBUG MARKER: == sanity test 244: sendfile with group lock tests =================================================== 01:49:02 (1544752142) [ 4812.430778] Lustre: DEBUG MARKER: == sanity test 245: check mdc connection flag/data: multiple modify RPCs ============================= 01:49:17 (1544752157) [ 4813.677791] Lustre: DEBUG MARKER: == sanity test 246: Read file of size 4095 should return right length ================================ 01:49:18 (1544752158) [ 4815.513793] Lustre: DEBUG MARKER: == sanity test 247a: mount subdir as fileset ========================================================= 01:49:20 (1544752160) [ 4815.598009] Lustre: Mounted lustre-client [ 4815.658848] Lustre: Unmounted lustre-client [ 4817.304705] Lustre: DEBUG MARKER: == sanity test 247b: mount subdir that dose not exist ================================================ 01:49:22 (1544752162) [ 4817.371027] LustreError: 12670:0:(llite_lib.c:501:client_common_fill_super()) cannot mds_connect: rc = -2 [ 4817.389171] LustreError: 12670:0:(obd_mount.c:1608:lustre_fill_super()) Unable to mount (-2) [ 4818.622882] Lustre: DEBUG MARKER: == sanity test 247c: running fid2path outside root =================================================== 01:49:23 (1544752163) [ 4818.703288] Lustre: Mounted lustre-client [ 4818.703792] Lustre: Skipped 1 previous similar message [ 4818.765624] Lustre: Unmounted lustre-client [ 4818.766131] Lustre: Skipped 2 previous similar messages [ 4820.320952] Lustre: DEBUG MARKER: == sanity test 247d: running fid2path inside root ==================================================== 01:49:25 (1544752165) [ 4822.182634] Lustre: DEBUG MARKER: == sanity test 247e: mount .. as fileset ============================================================= 01:49:26 (1544752166) [ 4822.368661] LustreError: 11-0: lustre-MDT0000-mdc-ffffa1248bcc7000: operation mds_get_root to node 10.9.6.154@tcp failed: rc = -22 [ 4822.370010] LustreError: 14339:0:(llite_lib.c:501:client_common_fill_super()) cannot mds_connect: rc = -22 [ 4822.387512] LustreError: 14339:0:(obd_mount.c:1608:lustre_fill_super()) Unable to mount (-22) [ 4823.629426] Lustre: DEBUG MARKER: == sanity test 248: fast read verification =========================================================== 01:49:28 (1544752168) [ 4834.689074] Lustre: DEBUG MARKER: == sanity test 249: Write above 2T file size ========================================================= 01:49:39 (1544752179) [ 4836.117918] Lustre: DEBUG MARKER: == sanity test 250: Write above 16T limit ============================================================ 01:49:40 (1544752180) [ 4837.367473] Lustre: DEBUG MARKER: == sanity test 251: Handling short read and write correctly ========================================== 01:49:42 (1544752182) [ 4837.387584] Lustre: *** cfs_fail_loc=1407, val=0*** [ 4838.670499] Lustre: DEBUG MARKER: == sanity test 252: check lr_reader tool ============================================================= 01:49:43 (1544752183) [ 4841.172212] Lustre: DEBUG MARKER: SKIP: sanity test_253 skipping ALWAYS excluded test 253 [ 4841.448198] Lustre: DEBUG MARKER: == sanity test 254: Check changelog size ============================================================= 01:49:46 (1544752186) [ 4841.890746] Lustre: DEBUG MARKER: SKIP: sanity test_254 MDS does not support changelog_size [ 4842.175511] Lustre: DEBUG MARKER: == sanity test 255a: check 'lfs ladvise -a willread' ================================================= 01:49:46 (1544752186) [ 5176.939789] Lustre: DEBUG MARKER: == sanity test 255b: check 'lfs ladvise -a dontneed' ================================================= 01:55:21 (1544752521) [ 5184.201488] Lustre: DEBUG MARKER: == sanity test 255c: suite of ladvise lockahead tests ================================================ 01:55:28 (1544752528) [ 5187.586519] Lustre: DEBUG MARKER: == sanity test 256: Check llog delete for empty and not full state =================================== 01:55:32 (1544752532) [ 5191.028273] Lustre: DEBUG MARKER: sanity test_256: @@@@@@ FAIL: Fail to start MDT [ 5203.091068] Lustre: DEBUG MARKER: == sanity test 257: xattr locks are not lost ========================================================= 01:55:47 (1544752547) [ 5203.525509] LustreError: 11-0: lustre-MDT0000-mdc-ffffa124a8966000: operation ldlm_enqueue to node 10.9.6.154@tcp failed: rc = -14 [ 5215.054698] Lustre: DEBUG MARKER: == sanity test 258a: ================================================================================= 01:55:59 (1544752559) [ 5215.067892] Lustre: lustre-MDT0000-mdc-ffffa124a8966000: Connection to lustre-MDT0000 (at 10.9.6.154@tcp) was lost; in progress operations using this service will wait for recovery to complete [ 5215.069693] Lustre: Skipped 1 previous similar message [ 5215.885574] Lustre: lustre-MDT0000-mdc-ffffa124a8966000: Connection restored to 10.9.6.154@tcp (at 10.9.6.154@tcp) [ 5215.886739] Lustre: Skipped 1 previous similar message [ 5217.185258] Lustre: DEBUG MARKER: == sanity test 258b: verify i_mutex security behavior ================================================ 01:56:01 (1544752561) [ 5218.435624] Lustre: DEBUG MARKER: == sanity test 259: crash at delayed truncate ======================================================== 01:56:03 (1544752563) [ 5223.678771] LustreError: 166-1: MGC10.9.6.154@tcp: Connection to MGS (at 10.9.6.154@tcp) was lost; in progress operations using this service will fail [ 5223.680748] Lustre: Evicted from MGS (at 10.9.6.154@tcp) after server handle changed from 0xad93bf9f007da9b7 to 0xad93bf9f0088ebe2 [ 5239.941139] Lustre: DEBUG MARKER: == sanity test 260: Check mdc_close fail ============================================================= 01:56:24 (1544752584) [ 5239.959660] LustreError: 11-0: lustre-OST0000-osc-ffffa124a8966000: operation ost_setattr to node 10.9.6.155@tcp failed: rc = -107 [ 5239.960914] LustreError: Skipped 1 previous similar message [ 5241.999910] Lustre: *** cfs_fail_loc=806, val=0*** [ 5242.000522] Lustre: 23899:0:(mdc_request.c:907:mdc_close()) lustre-MDT0000-mdc-ffffa124a8966000: close of FID [0x20000f635:0x13d7:0x0] failed, file reference will be dropped when this client unmounts or is evicted [ 5242.002482] LustreError: 23899:0:(file.c:216:ll_close_inode_openhandle()) lustre-clilmv-ffffa124a8966000: inode [0x20000f635:0x13d7:0x0] mdc close failed: rc = -12 [ 5243.242293] Lustre: DEBUG MARKER: == sanity test 270a: DoM: basic functionality tests ================================================== 01:56:28 (1544752588) [ 5251.677472] Lustre: DEBUG MARKER: == sanity test 270b: DoM: maximum size overflow checks for DoM-only file ============================= 01:56:36 (1544752596) [ 5253.155115] Lustre: DEBUG MARKER: == sanity test 270c: DoM: DoM EA inheritance tests =================================================== 01:56:37 (1544752597) [ 5254.617357] Lustre: DEBUG MARKER: == sanity test 270d: DoM: change striping from DoM to RAID0 ========================================== 01:56:39 (1544752599) [ 5256.070366] Lustre: DEBUG MARKER: == sanity test 270e: DoM: lfs find with DoM files test =============================================== 01:56:40 (1544752600) [ 5257.625535] Lustre: DEBUG MARKER: == sanity test 270f: DoM: maximum DoM stripe size checks ============================================= 01:56:42 (1544752602) [ 5261.161126] Lustre: DEBUG MARKER: == sanity test 271a: DoM: data is cached for read after write ======================================== 01:56:45 (1544752605) [ 5262.685419] Lustre: DEBUG MARKER: == sanity test 271b: DoM: no glimpse RPC for stat (DoM only file) ==================================== 01:56:47 (1544752607) [ 5264.155385] Lustre: DEBUG MARKER: == sanity test 271ba: DoM: no glimpse RPC for stat (combined file) =================================== 01:56:48 (1544752608) [ 5265.703613] Lustre: DEBUG MARKER: == sanity test 271c: DoM: IO lock at open saves enqueue RPCs ========================================= 01:56:50 (1544752610) [ 5276.706965] Lustre: DEBUG MARKER: == sanity test 271d: DoM: read on open (1K file in reply buffer) ===================================== 01:57:01 (1544752621) [ 5278.598209] Lustre: DEBUG MARKER: == sanity test 271e: DoM: read on open (30K file with reply buffer adjusting) ======================== 01:57:03 (1544752623) [ 5280.165060] Lustre: DEBUG MARKER: == sanity test 271f: DoM: read on open (200K file and read tail) ===================================== 01:57:04 (1544752624) [ 5281.718153] Lustre: DEBUG MARKER: == sanity test 272a: DoM migration: new layout with the same DOM component =========================== 01:57:06 (1544752626) [ 5282.525762] Lustre: DEBUG MARKER: sanity test_272a: @@@@@@ FAIL: layout was not changed silently