[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-7.9-debug (green@centos7-base) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-44) (GCC) ) #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013edfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-1.fc39 04/01/2014 [ 0.000000] Hypervisor detected: KVM [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x13ee00 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: write-back [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable [ 0.000000] 1 disabled [ 0.000000] 2 disabled [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f53f0-0x000f53ff] mapped at [ffffffffff2003f0] [ 0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x023c1000, 0x023c1fff] PGTABLE [ 0.000000] BRK [0x023c2000, 0x023c2fff] PGTABLE [ 0.000000] BRK [0x023c3000, 0x023c3fff] PGTABLE [ 0.000000] BRK [0x023c4000, 0x023c4fff] PGTABLE [ 0.000000] BRK [0x023c5000, 0x023c5fff] PGTABLE [ 0.000000] BRK [0x023c6000, 0x023c6fff] PGTABLE [ 0.000000] RAMDISK: [mem 0xbc2e2000-0xbffbffff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f5200 00014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 00000000bffe1d87 00034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 00000000bffe1c23 00074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 00000000bffe0040 01BE3 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 00000000bffe0000 00040 [ 0.000000] ACPI: APIC 00000000bffe1c97 00090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 00000000bffe1d27 00038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 00000000bffe1d5f 00028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000013edfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x13e5e3000-0x13e609fff] [ 0.000000] Reserving 128MB of memory at 768MB for crashkernel (System RAM: 4077MB) [ 0.000000] kvm-clock: cpu 0, msr 1:3e592001, primary cpu clock [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 340058740 cycles [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x13edfffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0009efff] [ 0.000000] node 0: [mem 0x00100000-0xbffcdfff] [ 0.000000] node 0: [mem 0x100000000-0x13edfffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x13edfffff] [ 0.000000] On node 0 totalpages: 1043820 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 12224 pages used for memmap [ 0.000000] DMA32 zone: 782286 pages, LIFO batch:31 [ 0.000000] Normal zone: 4024 pages used for memmap [ 0.000000] Normal zone: 257536 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ5 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] ACPI: IRQ10 used by override. [ 0.000000] ACPI: IRQ11 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 38 pages/cpu s115176 r8192 d32280 u524288 [ 0.000000] pcpu-alloc: s115176 r8192 d32280 u524288 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 0 1 2 3 [ 0.000000] KVM setup async PF for cpu 0 [ 0.000000] kvm-stealtime: cpu 0, msr 13e2135c0 [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes) [ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 1027487 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:centos7:ext4:ro:-p,-b4096 ro crashkernel=128M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] audit: disabled (until reboot) [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 3820268k/5224448k available (8172k kernel code, 1049168k absent, 355012k reserved, 5773k data, 2532k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=4. [ 0.000000] Offload RCU callbacks from all CPUs [ 0.000000] Offload RCU callbacks from CPUs: 0-3. [ 0.000000] NR_IRQS:327936 nr_irqs:456 0 [ 0.000000] Console: colour *CGA 80x25 [ 0.000000] console [ttyS1] enabled [ 0.000000] allocated 25165824 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ODEBUG: 73 of 73 active objects replaced [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.447919] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.451029] pid_max: default: 32768 minimum: 301 [ 0.453253] Security Framework initialized [ 0.454894] SELinux: Initializing. [ 0.456933] SELinux: Starting in permissive mode [ 0.459166] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.464143] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.466614] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.467934] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.471055] Initializing cgroup subsys memory [ 0.472622] Initializing cgroup subsys devices [ 0.474707] Initializing cgroup subsys freezer [ 0.476998] Initializing cgroup subsys net_cls [ 0.479163] Initializing cgroup subsys blkio [ 0.481105] Initializing cgroup subsys perf_event [ 0.483169] Initializing cgroup subsys hugetlb [ 0.485021] Initializing cgroup subsys pids [ 0.487206] Initializing cgroup subsys net_prio [ 0.489486] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.493571] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.496101] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.498689] tlb_flushall_shift: 6 [ 0.500382] FEATURE SPEC_CTRL Present [ 0.502075] FEATURE IBPB_SUPPORT Present [ 0.503873] Spectre V2 : Enabling Indirect Branch Prediction Barrier [ 0.506878] Spectre V2 : Vulnerable [ 0.508413] Speculative Store Bypass: Vulnerable [ 0.511584] debug: unmapping init [mem 0xffffffff82019000-0xffffffff8201ffff] [ 0.521365] ACPI: Core revision 20130517 [ 0.525834] ACPI: All ACPI Tables successfully acquired [ 0.528513] ftrace: allocating 30294 entries in 119 pages [ 0.598309] Enabling x2apic [ 0.599677] Enabled x2apic [ 0.601333] Switched APIC routing to physical x2apic. [ 0.605961] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.608612] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (fam: 06, model: 3e, stepping: 04) [ 0.612268] TSC deadline timer enabled [ 0.612444] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.615549] ... version: 2 [ 0.616827] ... bit width: 48 [ 0.618127] ... generic registers: 4 [ 0.619320] ... value mask: 0000ffffffffffff [ 0.620967] ... max period: 00007fffffffffff [ 0.622617] ... fixed-purpose events: 3 [ 0.623751] ... event mask: 000000070000000f [ 0.627417] KVM setup paravirtual spinlock [ 0.635915] kvm-clock: cpu 1, msr 1:3e592041, secondary cpu clock [ 0.663301] KVM setup async PF for cpu 1 [ 0.666422] kvm-stealtime: cpu 1, msr 13e2935c0 [ 0.669991] kvm-clock: cpu 2, msr 1:3e592081, secondary cpu clock [ 0.633872] smpboot: Booting Node 0, Processors #1 #2 #3 OK [ 0.705305] KVM setup async PF for cpu 2 [ 0.705594] kvm-clock: cpu 3, msr 1:3e5920c1, secondary cpu clock [ 0.709590] kvm-stealtime: cpu 2, msr 13e3135c0 [ 0.711203] KVM setup async PF for cpu 3 [ 0.712445] kvm-stealtime: cpu 3, msr 13e3935c0 [ 0.713966] Brought up 4 CPUs [ 0.714879] smpboot: Max logical packages: 1 [ 0.716323] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.725321] devtmpfs: initialized [ 0.727231] x86/mm: Memory block size: 128MB [ 0.735523] EVM: security.selinux [ 0.737099] EVM: security.ima [ 0.738671] EVM: security.capability [ 0.743634] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.746531] NET: Registered protocol family 16 [ 0.748300] cpuidle: using governor haltpoll [ 0.750052] ACPI: bus type PCI registered [ 0.751179] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.753490] PCI: Using configuration type 1 for base access [ 0.755377] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.768926] ACPI: Added _OSI(Module Device) [ 0.775515] ACPI: Added _OSI(Processor Device) [ 0.778720] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.783972] ACPI: Added _OSI(Processor Aggregator Device) [ 0.787560] ACPI: Added _OSI(Linux-Dell-Video) [ 0.791745] ACPI: EC: Look up EC in DSDT [ 0.799578] ACPI: Interpreter enabled [ 0.803559] ACPI: (supports S0 S3 S4 S5) [ 0.807877] ACPI: Using IOAPIC for interrupt routing [ 0.812741] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.824650] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.850084] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.853982] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI] [ 0.860357] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM [ 0.864413] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.868638] acpiphp: Slot [2] registered [ 0.873084] acpiphp: Slot [5] registered [ 0.874363] acpiphp: Slot [6] registered [ 0.875650] acpiphp: Slot [7] registered [ 0.876849] acpiphp: Slot [8] registered [ 0.878133] acpiphp: Slot [9] registered [ 0.879374] acpiphp: Slot [10] registered [ 0.880732] acpiphp: Slot [3] registered [ 0.882017] acpiphp: Slot [4] registered [ 0.883360] acpiphp: Slot [11] registered [ 0.884665] acpiphp: Slot [12] registered [ 0.885868] acpiphp: Slot [13] registered [ 0.887181] acpiphp: Slot [14] registered [ 0.892651] acpiphp: Slot [15] registered [ 0.893957] acpiphp: Slot [16] registered [ 0.895236] acpiphp: Slot [17] registered [ 0.896461] acpiphp: Slot [18] registered [ 0.897857] acpiphp: Slot [19] registered [ 0.899145] acpiphp: Slot [20] registered [ 0.900339] acpiphp: Slot [21] registered [ 0.901533] acpiphp: Slot [22] registered [ 0.902745] acpiphp: Slot [23] registered [ 0.904159] acpiphp: Slot [24] registered [ 0.905462] acpiphp: Slot [25] registered [ 0.906725] acpiphp: Slot [26] registered [ 0.908760] acpiphp: Slot [27] registered [ 0.910024] acpiphp: Slot [28] registered [ 0.911276] acpiphp: Slot [29] registered [ 0.912748] acpiphp: Slot [30] registered [ 0.914040] acpiphp: Slot [31] registered [ 0.915324] PCI host bridge to bus 0000:00 [ 0.917117] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.919183] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.921081] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.923335] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.925425] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 0.928968] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.934011] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.934857] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.935822] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.944003] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.947810] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.951364] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.953611] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.955796] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.960325] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.961000] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.964260] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.970128] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.972649] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.988733] pci 0000:00:02.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref] [ 0.991450] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.997675] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 1.007523] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 1.016396] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 1.039993] pci 0000:00:05.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref] [ 1.048548] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 1.055912] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 1.065585] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 1.086137] pci 0000:00:06.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref] [ 1.099594] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 1.103584] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 1.109825] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 1.135621] pci 0000:00:07.0: reg 0x20: [mem 0x38000000c000-0x38000000ffff 64bit pref] [ 1.139980] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 1.142987] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 1.148554] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 1.165896] pci 0000:00:08.0: reg 0x20: [mem 0x380000010000-0x380000013fff 64bit pref] [ 1.178147] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 1.182285] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 1.185398] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 1.198685] pci 0000:00:09.0: reg 0x20: [mem 0x380000014000-0x380000017fff 64bit pref] [ 1.206095] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 1.217818] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 1.236218] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 1.291545] pci 0000:00:0a.0: reg 0x20: [mem 0x380000018000-0x38000001bfff 64bit pref] [ 1.313131] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11) [ 1.316335] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11) [ 1.318632] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11) [ 1.320150] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11) [ 1.322813] ACPI: PCI Interrupt Link [LNKS] (IRQs *9) [ 1.326945] vgaarb: loaded [ 1.332663] SCSI subsystem initialized [ 1.334739] ACPI: bus type USB registered [ 1.337786] usbcore: registered new interface driver usbfs [ 1.339548] usbcore: registered new interface driver hub [ 1.342069] usbcore: registered new device driver usb [ 1.345195] PCI: Using ACPI for IRQ routing [ 1.346567] PCI: pci_cache_line_size set to 64 bytes [ 1.347042] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [ 1.347048] e820: reserve RAM buffer [mem 0xbffce000-0xbfffffff] [ 1.347050] e820: reserve RAM buffer [mem 0x13ee00000-0x13fffffff] [ 1.350306] NetLabel: Initializing [ 1.351290] NetLabel: domain hash size = 128 [ 1.355475] NetLabel: protocols = UNLABELED CIPSOv4 [ 1.357703] NetLabel: unlabeled traffic allowed by default [ 1.363297] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 1.367761] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 1.375856] amd_nb: Cannot enumerate AMD northbridges [ 1.382847] Switched to clocksource kvm-clock [ 1.434151] pnp: PnP ACPI init [ 1.439210] ACPI: bus type PNP registered [ 1.441158] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active) [ 1.441245] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active) [ 1.441296] pnp 00:02: [dma 2] [ 1.441334] pnp 00:02: Plug and Play ACPI device, IDs PNP0700 (active) [ 1.441421] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 1.441521] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 1.441605] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active) [ 1.442545] pnp: PnP ACPI: found 6 devices [ 1.446031] ACPI: bus type PNP unregistered [ 1.476579] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.476586] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 1.476589] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.476591] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 1.476594] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x38007fffffff window] [ 1.476711] NET: Registered protocol family 2 [ 1.482864] TCP established hash table entries: 32768 (order: 6, 262144 bytes) [ 1.490355] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes) [ 1.496422] TCP: Hash tables configured (established 32768 bind 32768) [ 1.503440] TCP: reno registered [ 1.504625] UDP hash table entries: 2048 (order: 5, 196608 bytes) [ 1.510912] UDP-Lite hash table entries: 2048 (order: 5, 196608 bytes) [ 1.517023] NET: Registered protocol family 1 [ 1.526599] RPC: Registered named UNIX socket transport module. [ 1.530942] RPC: Registered udp transport module. [ 1.534393] RPC: Registered tcp transport module. [ 1.537713] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 1.540977] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 1.543422] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 1.545253] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 1.547202] PCI: CLS 0 bytes, default 64 [ 1.553283] Unpacking initramfs... [ 3.951290] hrtimer: interrupt took 4483729 ns [ 4.382025] debug: unmapping init [mem 0xffff8800bc2e2000-0xffff8800bffbffff] [ 4.385809] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.387931] software IO TLB [mem 0xb82e2000-0xbc2e2000] (64MB) mapped at [ffff8800b82e2000-ffff8800bc2e1fff] [ 4.391115] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 10737418240 ms ovfl timer [ 4.393622] RAPL PMU: hw unit of domain pp0-core 2^-0 Joules [ 4.395590] RAPL PMU: hw unit of domain package 2^-0 Joules [ 4.397312] RAPL PMU: hw unit of domain dram 2^-0 Joules [ 4.406525] cryptomgr_test (52) used greatest stack depth: 14480 bytes left [ 4.411217] futex hash table entries: 1024 (order: 4, 65536 bytes) [ 4.414791] Initialise system trusted keyring [ 4.465289] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 4.468077] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 4.481176] zpool: loaded [ 4.482150] zbud: loaded [ 4.483461] VFS: Disk quotas dquot_6.6.0 [ 4.485048] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 4.490750] NFS: Registering the id_resolver key type [ 4.492580] Key type id_resolver registered [ 4.494249] Key type id_legacy registered [ 4.495975] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 4.499589] Key type big_key registered [ 4.500998] SELinux: Registering netfilter hooks [ 4.507989] cryptomgr_test (58) used greatest stack depth: 14048 bytes left [ 4.519566] cryptomgr_test (63) used greatest stack depth: 13984 bytes left [ 4.527479] NET: Registered protocol family 38 [ 4.530686] Key type asymmetric registered [ 4.535868] Asymmetric key parser 'x509' registered [ 4.542616] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 4.550241] io scheduler noop registered [ 4.552018] io scheduler deadline registered (default) [ 4.554020] io scheduler cfq registered [ 4.555413] io scheduler mq-deadline registered [ 4.559656] io scheduler kyber registered [ 4.571423] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 4.576047] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 4.580849] intel_idle: does not run on family 6 model 62 [ 4.580998] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 4.587123] ACPI: Power Button [PWRF] [ 4.595986] GHES: HEST is not enabled! [ 4.672479] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10 [ 4.752627] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 11 [ 4.961724] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11 [ 5.140533] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 10 [ 5.401756] tsc: Refined TSC clocksource calibration: 2399.960 MHz [ 5.416943] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 5.446880] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 5.474052] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 5.477238] Non-volatile memory driver v1.3 [ 5.478831] Linux agpgart interface v0.103 [ 5.480216] crash memory driver: version 1.1 [ 5.482260] nbd: registered device at major 43 [ 5.492401] virtio-pci 0000:00:05.0: irq 24 for MSI/MSI-X [ 5.492458] virtio-pci 0000:00:05.0: irq 25 for MSI/MSI-X [ 5.492513] virtio-pci 0000:00:05.0: irq 26 for MSI/MSI-X [ 5.492558] virtio-pci 0000:00:05.0: irq 27 for MSI/MSI-X [ 5.492597] virtio-pci 0000:00:05.0: irq 28 for MSI/MSI-X [ 5.500914] virtio_blk virtio1: [vda] 60784 512-byte logical blocks (31.1 MB/29.6 MiB) [ 5.512132] virtio-pci 0000:00:06.0: irq 29 for MSI/MSI-X [ 5.512176] virtio-pci 0000:00:06.0: irq 30 for MSI/MSI-X [ 5.512208] virtio-pci 0000:00:06.0: irq 31 for MSI/MSI-X [ 5.512244] virtio-pci 0000:00:06.0: irq 32 for MSI/MSI-X [ 5.512280] virtio-pci 0000:00:06.0: irq 33 for MSI/MSI-X [ 5.529631] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 5.543102] virtio-pci 0000:00:07.0: irq 34 for MSI/MSI-X [ 5.543163] virtio-pci 0000:00:07.0: irq 35 for MSI/MSI-X [ 5.543203] virtio-pci 0000:00:07.0: irq 36 for MSI/MSI-X [ 5.543240] virtio-pci 0000:00:07.0: irq 37 for MSI/MSI-X [ 5.543275] virtio-pci 0000:00:07.0: irq 38 for MSI/MSI-X [ 5.562779] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 5.580936] virtio-pci 0000:00:08.0: irq 39 for MSI/MSI-X [ 5.580984] virtio-pci 0000:00:08.0: irq 40 for MSI/MSI-X [ 5.581034] virtio-pci 0000:00:08.0: irq 41 for MSI/MSI-X [ 5.581075] virtio-pci 0000:00:08.0: irq 42 for MSI/MSI-X [ 5.581117] virtio-pci 0000:00:08.0: irq 43 for MSI/MSI-X [ 5.607677] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 5.624859] virtio-pci 0000:00:09.0: irq 44 for MSI/MSI-X [ 5.624898] virtio-pci 0000:00:09.0: irq 45 for MSI/MSI-X [ 5.624947] virtio-pci 0000:00:09.0: irq 46 for MSI/MSI-X [ 5.624993] virtio-pci 0000:00:09.0: irq 47 for MSI/MSI-X [ 5.625038] virtio-pci 0000:00:09.0: irq 48 for MSI/MSI-X [ 5.653022] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 5.678424] virtio-pci 0000:00:0a.0: irq 49 for MSI/MSI-X [ 5.678473] virtio-pci 0000:00:0a.0: irq 50 for MSI/MSI-X [ 5.678511] virtio-pci 0000:00:0a.0: irq 51 for MSI/MSI-X [ 5.678546] virtio-pci 0000:00:0a.0: irq 52 for MSI/MSI-X [ 5.678591] virtio-pci 0000:00:0a.0: irq 53 for MSI/MSI-X [ 5.696788] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 5.711482] rdac: device handler registered [ 5.714971] hp_sw: device handler registered [ 5.719495] emc: device handler registered [ 5.721090] libphy: Fixed MDIO Bus: probed [ 5.735152] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 5.741364] ehci-pci: EHCI PCI platform driver [ 5.743552] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 5.747203] ohci-pci: OHCI PCI platform driver [ 5.748852] uhci_hcd: USB Universal Host Controller Interface driver [ 5.752731] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 5.759095] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 5.762994] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 5.772389] mousedev: PS/2 mouse device common for all mice [ 5.778895] rtc_cmos 00:05: RTC can wake from S4 [ 5.787375] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0 [ 5.791613] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 5.806825] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 5.826813] hidraw: raw HID events driver (C) Jiri Kosina [ 5.838560] usbcore: registered new interface driver usbhid [ 5.840313] usbhid: USB HID core driver [ 5.843498] drop_monitor: Initializing network drop monitor service [ 5.850916] Netfilter messages via NETLINK v0.30. [ 5.852715] TCP: cubic registered [ 5.859317] Initializing XFRM netlink socket [ 5.863267] NET: Registered protocol family 10 [ 5.872326] NET: Registered protocol family 17 [ 5.877229] Key type dns_resolver registered [ 5.881353] mce: Using 10 MCE banks [ 5.886684] Loading compiled-in X.509 certificates [ 5.893069] Loaded X.509 cert 'Magrathea: Glacier signing key: e34d0e1b7fcf5b414cce75d36d8482945c781ed6' [ 5.899455] registered taskstats version 1 [ 5.909089] modprobe (72) used greatest stack depth: 13456 bytes left [ 5.940864] Key type trusted registered [ 6.104666] Key type encrypted registered [ 6.114899] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 6.140537] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 6.165947] rtc_cmos 00:05: setting system clock to 2024-04-19 06:09:03 UTC (1713506943) [ 6.178307] debug: unmapping init [mem 0xffffffff81da0000-0xffffffff82018fff] [ 6.193143] Write protecting the kernel read-only data: 12288k [ 6.202416] debug: unmapping init [mem 0xffff8800017fe000-0xffff8800017fffff] [ 6.206147] debug: unmapping init [mem 0xffff880001b9b000-0xffff880001bfffff] [ 6.253071] random: systemd: uninitialized urandom read (16 bytes read) [ 6.273273] random: systemd: uninitialized urandom read (16 bytes read) [ 6.280598] random: systemd: uninitialized urandom read (16 bytes read) [ 6.293870] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 6.315550] systemd[1]: Detected virtualization kvm. [ 6.326630] systemd[1]: Detected architecture x86-64. [ 6.328114] systemd[1]: Running in initial RAM disk. [ 6.350910] systemd[1]: No hostname configured. [ 6.359011] systemd[1]: Set hostname to . [ 6.375585] random: systemd: uninitialized urandom read (16 bytes read) [ 6.377265] systemd[1]: Initializing machine ID from random generator. [ 6.641331] dracut-rootfs-g (86) used greatest stack depth: 13264 bytes left [ 6.652449] random: systemd: uninitialized urandom read (16 bytes read) [ 6.657731] random: systemd: uninitialized urandom read (16 bytes read) [ 6.664981] random: systemd: uninitialized urandom read (16 bytes read) [ 6.670706] random: systemd: uninitialized urandom read (16 bytes read) [ 6.686506] random: systemd: uninitialized urandom read (16 bytes read) [ 6.696027] random: systemd: uninitialized urandom read (16 bytes read) [ 6.767604] systemd[1]: Created slice Root Slice. [ 6.788003] systemd[1]: Listening on udev Kernel Socket. [ 6.806761] systemd[1]: Created slice System Slice. [ 6.819912] systemd[1]: Reached target Slices. [ 6.833942] systemd[1]: Reached target Timers. [ 6.850959] systemd[1]: Reached target Local File Systems. [ 6.861351] systemd[1]: Reached target Swap. [ 6.869133] systemd[1]: Listening on udev Control Socket. [ 6.877767] systemd[1]: Listening on Journal Socket. [ 6.884888] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2 [ 6.891875] systemd[1]: Starting Load Kernel Modules... [ 6.897163] systemd[1]: Reached target Sockets. [ 6.907330] systemd[1]: Starting dracut cmdline hook... [ 6.919490] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 6.936035] systemd[1]: Starting Journal Service... [ 6.952564] systemd[1]: Starting Setup Virtual Console... [ 6.965158] systemd[1]: Started Load Kernel Modules. [ 6.981553] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 6.993881] systemd[1]: Started Setup Virtual Console. [ 7.007554] systemd[1]: Starting Create Static Device Nodes in /dev... [ 7.026331] systemd[1]: Starting Apply Kernel Variables... [ 7.058065] systemd[1]: Started Journal Service. [ 9.074744] libata version 3.00 loaded. [ 9.287473] random: fast init done [ 9.927228] ata_piix 0000:00:01.1: version 2.13 [ 10.223136] scsi host0: ata_piix [ 10.291912] scsi host1: ata_piix [ 10.293022] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 10.307399] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 10.720350] ip (324) used greatest stack depth: 13080 bytes left [ 11.007892] ip (347) used greatest stack depth: 12336 bytes left [ 14.774392] systemd-udevd (264) used greatest stack depth: 12160 bytes left [ 15.450382] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ 16.285026] systemd-journald[108]: Received SIGTERM from PID 1 (systemd). [ 17.257386] SELinux: Disabled at runtime. [ 17.258654] SELinux: Unregistering netfilter hooks [ 17.508790] ip_tables: (C) 2000-2006 Netfilter Core Team [ 17.518122] systemd[1]: Inserted module 'ip_tables' [ 19.364421] systemd-journald[567]: Received request to flush runtime journal from PID 1 [ 20.049483] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 20.317824] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 20.564214] cryptd: max_cpu_qlen set to 1000 [ 20.796251] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS [ 21.012345] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 21.627751] AVX version of gcm_enc/dec engaged. [ 21.629015] AES CTR mode by8 optimization enabled [ 21.650372] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 21.690282] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 22.654487] EDAC MC: Ver: 3.0.0 [ 22.720780] EDAC sbridge: Seeking for: PCI ID 8086:0ea0 [ 22.720792] EDAC sbridge: Ver: 1.1.2 [ 32.598597] mount.nfs (784) used greatest stack depth: 10616 bytes left [ 49.274927] device-mapper: uevent: version 1.0.3 [ 49.279861] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 56.480118] libcfs: loading out-of-tree module taints kernel. [ 56.484915] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 56.509707] LNet: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 56.521264] alg: No test for adler32 (adler32-zlib) [ 57.345827] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_hostid [ 65.605570] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local [ 66.399809] Lustre: Lustre: Build Version: 2.15.4_18_g9f02020 [ 66.739402] LNet: Added LNI 192.168.201.138@tcp [8/256/0/180] [ 66.744688] LNet: Accept secure, port 988 [ 68.356749] Key type lgssc registered [ 68.843799] Lustre: Echo OBD driver; http://www.lustre.org/ [ 74.556196] icp: module license 'CDDL' taints kernel. [ 74.560631] Disabling lock debugging due to kernel taint [ 78.282179] ZFS: Loaded module v0.8.6-1, ZFS pool version 5000, ZFS filesystem version 5 [ 82.681757] LDISKFS-fs (vdc): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 91.062932] LDISKFS-fs (vdd): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 97.086679] LDISKFS-fs (vde): file extents enabled, maximum tree depth=5 [ 97.103796] LDISKFS-fs (vde): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 103.023531] LDISKFS-fs (vdf): file extents enabled, maximum tree depth=5 [ 103.037086] LDISKFS-fs (vdf): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 111.469796] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local [ 118.488594] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 118.551300] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 119.679459] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall in log lustre-MDT0000 [ 119.701303] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space: rc = -61 [ 119.738948] Lustre: lustre-MDT0000: new disk, initializing [ 119.806145] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 119.819500] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 119.865884] mount.lustre (6875) used greatest stack depth: 10064 bytes left [ 121.836074] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 129.953880] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 129.994805] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 130.029547] Lustre: Setting parameter lustre-MDT0001.mdt.identity_upcall in log lustre-MDT0001 [ 130.044937] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space: rc = -61 [ 130.047549] Lustre: Skipped 1 previous similar message [ 130.106052] Lustre: lustre-MDT0001: new disk, initializing [ 130.146751] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 130.186339] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 130.196709] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 131.916161] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 138.713839] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 138.729981] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 138.772011] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 138.779635] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 138.789097] Lustre: lustre-OST0000-osd: enabled 'large_dir' feature on device /dev/mapper/ost1_flakey [ 138.915283] Lustre: lustre-OST0000: new disk, initializing [ 138.917371] Lustre: srv-lustre-OST0000: No data found on store. Initialize space: rc = -61 [ 138.946811] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 140.581083] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 140.669107] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 140.673754] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 146.434355] LDISKFS-fs (dm-3): file extents enabled, maximum tree depth=5 [ 146.443509] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro [ 146.495607] LDISKFS-fs (dm-3): file extents enabled, maximum tree depth=5 [ 146.502228] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 146.508993] Lustre: lustre-OST0001-osd: enabled 'large_dir' feature on device /dev/mapper/ost2_flakey [ 146.557787] Lustre: lustre-OST0001: new disk, initializing [ 146.559618] Lustre: srv-lustre-OST0001: No data found on store. Initialize space: rc = -61 [ 146.586677] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 148.370574] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 150.308498] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 150.315370] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 155.066089] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 155.159456] random: crng init done [ 160.377026] Lustre: Modifying parameter general.lod.*.mdt_hash in log params [ 167.264317] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing check_logdir /tmp/testlogs/ [ 170.242510] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing yml_node [ 173.028045] Lustre: DEBUG MARKER: Client: 2.15.4.18 [ 174.623983] Lustre: DEBUG MARKER: MDS: 2.15.4.18 [ 176.322197] Lustre: DEBUG MARKER: OSS: 2.15.4.18 [ 177.348043] Lustre: DEBUG MARKER: -----============= acceptance-small: sanity ============----- Fri Apr 19 02:11:54 EDT 2024 [ 180.751859] Lustre: DEBUG MARKER: excepting tests: 56oc 42a 42b 42c 407 [ 181.581940] Lustre: DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 115 135 136 230d 300o [ 185.372406] Lustre: DEBUG MARKER: oleg138-client.virtnet: executing check_config_client /mnt/lustre [ 198.484779] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 200.398125] Lustre: Modifying parameter general.lod.*.mdt_hash in log params [ 202.003372] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 204.193310] Lustre: DEBUG MARKER: == sanity test 0a: touch; rm ============================= 02:12:21 (1713507141) [ 207.407232] Lustre: DEBUG MARKER: == sanity test 0b: chmod 0755 /mnt/lustre ======================================================================================= 02:12:24 (1713507144) [ 210.472304] Lustre: DEBUG MARKER: == sanity test 0c: check import proc ===================== 02:12:27 (1713507147) [ 213.470557] Lustre: DEBUG MARKER: == sanity test 0d: check export proc ======================================================================================= 02:12:30 (1713507150) [ 218.449079] Lustre: DEBUG MARKER: == sanity test 0e: Enable DNE MDT balancing for mkdir in the ROOT ========================================================== 02:12:35 (1713507155) [ 221.537718] Lustre: DEBUG MARKER: == sanity test 1: mkdir; remkdir; rmdir ================== 02:12:38 (1713507158) [ 224.341203] Lustre: DEBUG MARKER: == sanity test 2: mkdir; touch; rmdir; check file ======== 02:12:41 (1713507161) [ 227.023427] Lustre: DEBUG MARKER: == sanity test 3: mkdir; touch; rmdir; check dir ========= 02:12:44 (1713507164) [ 229.724772] Lustre: DEBUG MARKER: == sanity test 4: mkdir; touch dir/file; rmdir; checkdir (expect error) ========================================================== 02:12:47 (1713507167) [ 232.317475] Lustre: DEBUG MARKER: == sanity test 5: mkdir .../d5 .../d5/d2; chmod .../d5/d2 ========================================================== 02:12:49 (1713507169) [ 236.000335] Lustre: DEBUG MARKER: == sanity test 6a: touch f6a; chmod f6a; runas -u 500 -g 500 chmod f6a (should return error) ============================================================ 02:12:52 (1713507172) [ 239.897433] Lustre: DEBUG MARKER: == sanity test 6c: touch f6c; chown f6c; runas -u 500 -g 500 chown f6c (should return error) ============================================================ 02:12:57 (1713507177) [ 243.057012] Lustre: DEBUG MARKER: == sanity test 6e: touch+chgrp ; runas -u 500 -g 500 chgrp (should return error) ========================================================== 02:13:00 (1713507180) [ 245.662286] Lustre: DEBUG MARKER: == sanity test 6g: verify new dir in sgid dir inherits group ========================================================== 02:13:03 (1713507183) [ 248.769548] Lustre: DEBUG MARKER: == sanity test 6h: runas -u 500 -g 500 chown RUNAS_ID.0 .../ (should return error) ========================================================== 02:13:06 (1713507186) [ 251.039386] Lustre: DEBUG MARKER: == sanity test 7a: mkdir .../d7; mcreate .../d7/f; chmod .../d7/f ============================================================== 02:13:08 (1713507188) [ 253.637131] Lustre: DEBUG MARKER: == sanity test 7b: mkdir .../d7; mcreate d7/f2; echo foo > d7/f2 =============================================================== 02:13:10 (1713507190) [ 256.403461] Lustre: DEBUG MARKER: == sanity test 8: mkdir .../d8; touch .../d8/f; chmod .../d8/f ================================================================= 02:13:13 (1713507193) [ 259.867545] Lustre: DEBUG MARKER: == sanity test 9: mkdir .../d9 .../d9/d2 .../d9/d2/d3 ========================================================================== 02:13:17 (1713507197) [ 262.276570] Lustre: DEBUG MARKER: == sanity test 10: mkdir .../d10 .../d10/d2; touch .../d10/d2/f ================================================================ 02:13:19 (1713507199) [ 264.790401] Lustre: DEBUG MARKER: == sanity test 11: mkdir .../d11 d11/d2; chmod .../d11/d2 ====================================================================== 02:13:22 (1713507202) [ 266.962407] Lustre: DEBUG MARKER: == sanity test 12: touch .../d12/f; chmod .../d12/f .../d12/f ================================================================== 02:13:24 (1713507204) [ 268.987511] Lustre: DEBUG MARKER: == sanity test 13: creat .../d13/f; dd .../d13/f; > .../d13/f ================================================================== 02:13:26 (1713507206) [ 271.134022] Lustre: DEBUG MARKER: == sanity test 14: touch .../d14/f; rm .../d14/f; rm .../d14/f ================================================================= 02:13:28 (1713507208) [ 273.477159] Lustre: DEBUG MARKER: == sanity test 15: touch .../d15/f; mv .../d15/f .../d15/f2 ==================================================================== 02:13:30 (1713507210) [ 276.251601] Lustre: DEBUG MARKER: == sanity test 16: touch .../d16/f; rm -rf .../d16/f ===== 02:13:33 (1713507213) [ 277.977101] Lustre: DEBUG MARKER: == sanity test 17a: symlinks: create, remove (real) ====== 02:13:35 (1713507215) [ 279.736525] Lustre: DEBUG MARKER: == sanity test 17b: symlinks: create, remove (dangling) == 02:13:37 (1713507217) [ 281.666489] Lustre: DEBUG MARKER: == sanity test 17c: symlinks: open dangling (should return error) ========================================================== 02:13:39 (1713507219) [ 283.462376] Lustre: DEBUG MARKER: == sanity test 17d: symlinks: create dangling ============ 02:13:40 (1713507220) [ 285.116720] Lustre: DEBUG MARKER: == sanity test 17e: symlinks: create recursive symlink (should return error) ========================================================== 02:13:42 (1713507222) [ 287.147494] Lustre: DEBUG MARKER: == sanity test 17f: symlinks: long and very long symlink name ========================================================== 02:13:44 (1713507224) [ 289.331589] Lustre: DEBUG MARKER: == sanity test 17g: symlinks: really long symlink name and inode boundaries ========================================================== 02:13:46 (1713507226) [ 291.737340] Lustre: DEBUG MARKER: == sanity test 17h: create objects: lov_free_memmd() doesn't lbug ========================================================== 02:13:49 (1713507229) [ 294.186597] Lustre: DEBUG MARKER: == sanity test 17i: don't panic on short symlink (should return error) ========================================================== 02:13:51 (1713507231) [ 294.627807] Lustre: *** cfs_fail_loc=143, val=0*** [ 296.899776] Lustre: DEBUG MARKER: == sanity test 17k: symlinks: rsync with xattrs enabled == 02:13:54 (1713507234) [ 300.073845] Lustre: DEBUG MARKER: == sanity test 17l: Ensure lgetxattr's returned xattr size is consistent ========================================================== 02:13:57 (1713507237) [ 302.699813] Lustre: DEBUG MARKER: == sanity test 17m: run e2fsck against MDT which contains short/long symlink ========================================================== 02:14:00 (1713507240) [ 329.765202] Lustre: Failing over lustre-MDT0001 [ 329.808050] LustreError: 25178:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 329.854722] Lustre: server umount lustre-MDT0001 complete [ 330.650014] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 330.650219] LustreError: 137-5: lustre-MDT0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 330.661426] Lustre: Skipped 1 previous similar message [ 332.730181] LustreError: 137-5: lustre-MDT0001_UUID: not available for connect from 192.168.201.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 332.743423] LustreError: Skipped 2 previous similar messages [ 333.925195] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 334.068984] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 335.401907] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 335.915004] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 339.070332] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to (at 0@lo) [ 339.078432] Lustre: lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. [ 339.101258] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:8 to 0x280000400:33 [ 339.107941] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:8 to 0x2c0000400:33 [ 346.538733] Lustre: DEBUG MARKER: == sanity test 17n: run e2fsck against master/slave MDT which contains remote dir ========================================================== 02:14:44 (1713507284) [ 348.437348] Lustre: Failing over lustre-MDT0000 [ 348.482468] LustreError: 26780:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 348.485471] LustreError: 26780:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 21 previous similar messages [ 348.524098] Lustre: server umount lustre-MDT0000 complete [ 349.051373] LustreError: 11-0: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 349.055608] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 349.063948] Lustre: Skipped 1 previous similar message [ 349.066494] LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 352.579781] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 352.633313] LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 352.633328] LustreError: 166-1: MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 352.633513] Lustre: Evicted from MGS (at 192.168.201.138@tcp) after server handle changed from 0xfda85de0e55d6583 to 0xfda85de0e5602a2e [ 352.633869] Lustre: MGC192.168.201.138@tcp: Connection restored to (at 0@lo) [ 352.633871] Lustre: Skipped 2 previous similar messages [ 352.650928] LustreError: Skipped 7 previous similar messages [ 352.718303] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 353.892981] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 355.762874] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 357.723835] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to (at 0@lo) [ 357.734999] Lustre: lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. [ 357.756060] Lustre: lustre-OST0000: deleting orphan objects from 0x0:44 to 0x0:65 [ 357.756295] Lustre: lustre-OST0001: deleting orphan objects from 0x0:44 to 0x0:65 [ 358.397603] Lustre: Failing over lustre-MDT0001 [ 358.444206] LustreError: 28125:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 358.448022] LustreError: 28125:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 27 previous similar messages [ 358.487019] Lustre: server umount lustre-MDT0001 complete [ 360.778943] LustreError: 137-5: lustre-MDT0001_UUID: not available for connect from 192.168.201.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 362.376503] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 362.496935] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 362.507307] Lustre: Skipped 4 previous similar messages [ 363.601676] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 364.228122] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 367.553040] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to (at 0@lo) [ 367.560160] Lustre: Skipped 3 previous similar messages [ 367.577796] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 367.606990] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:49 to 0x280000400:65 [ 369.915916] Lustre: Failing over lustre-MDT0000 [ 369.960609] LustreError: 29453:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 369.963541] LustreError: 29453:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 3 previous similar messages [ 370.001533] Lustre: server umount lustre-MDT0000 complete [ 372.523305] LustreError: 11-0: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 372.527319] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 372.534957] Lustre: Skipped 1 previous similar message [ 372.538400] LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 374.705150] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 374.789945] LustreError: 11-0: MGC192.168.201.138@tcp: operation mgs_target_reg to node 0@lo failed: rc = -107 [ 374.789994] LustreError: 166-1: MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 374.791126] Lustre: Evicted from MGS (at 192.168.201.138@tcp) after server handle changed from 0xfda85de0e5602a2e to 0xfda85de0e5604dd6 [ 374.804267] Lustre: MGC192.168.201.138@tcp: Connection restored to (at 0@lo) [ 374.808128] Lustre: Skipped 2 previous similar messages [ 374.924612] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 374.928046] Lustre: Skipped 1 previous similar message [ 376.564521] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 377.790672] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 378.759749] Lustre: Failing over lustre-MDT0001 [ 378.818003] LustreError: 30801:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 378.820500] LustreError: 30801:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 1 previous similar message [ 378.876787] Lustre: server umount lustre-MDT0001 complete [ 379.898573] LustreError: 11-0: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 379.901487] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 379.933388] Lustre: Skipped 3 previous similar messages [ 385.429869] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 385.627629] LustreError: 11-0: lustre-MDT0000-osp-MDT0001: operation mds_connect to node 0@lo failed: rc = -114 [ 385.728949] mount.lustre (31528) used greatest stack depth: 10048 bytes left [ 386.924491] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 387.872427] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 390.711541] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to (at 0@lo) [ 390.715342] Lustre: Skipped 2 previous similar messages [ 390.736770] Lustre: lustre-MDT0000: Recovery over after 0:13, of 2 clients 2 recovered and 0 were evicted. [ 390.760809] Lustre: lustre-OST0001: deleting orphan objects from 0x0:44 to 0x0:97 [ 390.761044] Lustre: lustre-OST0000: deleting orphan objects from 0x0:44 to 0x0:97 [ 390.811723] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:49 to 0x280000400:97 [ 390.811725] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:49 to 0x2c0000400:65 [ 396.482376] Lustre: Failing over lustre-MDT0000 [ 396.539169] LustreError: 32136:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 396.599244] Lustre: server umount lustre-MDT0000 complete [ 396.844453] LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 192.168.201.38@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [ 396.858329] LustreError: Skipped 15 previous similar messages [ 400.715142] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 400.725362] Lustre: Skipped 4 previous similar messages [ 401.431993] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 401.521664] LustreError: 166-1: MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 401.527736] Lustre: Evicted from MGS (at 192.168.201.138@tcp) after server handle changed from 0xfda85de0e5604dd6 to 0xfda85de0e5609891 [ 401.838059] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 403.677564] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 406.653980] Lustre: lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. [ 406.657386] Lustre: Skipped 1 previous similar message [ 406.704682] Lustre: lustre-OST0000: deleting orphan objects from 0x0:123 to 0x0:161 [ 406.704939] Lustre: lustre-OST0001: deleting orphan objects from 0x0:123 to 0x0:161 [ 411.627070] LustreError: 11-0: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [ 414.513707] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 414.760896] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 414.772008] Lustre: Skipped 2 previous similar messages [ 417.251563] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 419.759051] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to (at 0@lo) [ 419.767666] Lustre: Skipped 8 previous similar messages [ 419.795237] Lustre: lustre-MDT0001: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. [ 419.825936] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:123 to 0x280000400:161 [ 419.831395] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:91 to 0x2c0000400:129 [ 422.753676] Lustre: Failing over lustre-MDT0000 [ 422.757160] Lustre: Skipped 1 previous similar message [ 422.835585] LustreError: 2392:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 422.838760] LustreError: 2392:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 6 previous similar messages [ 422.931552] Lustre: server umount lustre-MDT0000 complete [ 422.934052] Lustre: Skipped 1 previous similar message [ 424.682542] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 424.693321] Lustre: Skipped 4 previous similar messages [ 429.772447] LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 429.788042] LustreError: Skipped 20 previous similar messages [ 430.127341] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 430.259272] LustreError: 11-0: MGC192.168.201.138@tcp: operation mgs_target_reg to node 0@lo failed: rc = -107 [ 430.260914] LustreError: 166-1: MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 430.261851] Lustre: Evicted from MGS (at 192.168.201.138@tcp) after server handle changed from 0xfda85de0e5609891 to 0xfda85de0e560bdf9 [ 430.298607] LustreError: Skipped 1 previous similar message [ 430.898499] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 430.913589] Lustre: Skipped 1 previous similar message [ 433.383665] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 435.594005] Lustre: lustre-OST0001: deleting orphan objects from 0x0:123 to 0x0:193 [ 435.596313] Lustre: lustre-OST0000: deleting orphan objects from 0x0:123 to 0x0:193 [ 443.617833] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 445.954472] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 448.870146] Lustre: lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. [ 448.873332] Lustre: Skipped 1 previous similar message [ 448.938436] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:91 to 0x2c0000400:161 [ 448.942250] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:123 to 0x280000400:193 [ 451.837020] Lustre: DEBUG MARKER: == sanity test 17o: stat file with incompat LMA feature == 02:16:28 (1713507388) [ 453.859039] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 454.944726] Lustre: lustre-MDT0001: Not available for connect from 192.168.201.38@tcp (stopping) [ 454.948843] Lustre: Skipped 2 previous similar messages [ 456.866742] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 456.873424] Lustre: Skipped 2 previous similar messages [ 459.722128] LustreError: 5363:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 459.733031] LustreError: 5363:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 2 previous similar messages [ 459.858807] Lustre: server umount lustre-MDT0001 complete [ 459.863756] Lustre: Skipped 1 previous similar message [ 474.842057] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 476.745010] Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect [ 476.747743] Lustre: Skipped 1 previous similar message [ 476.940362] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 480.029657] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to (at 0@lo) [ 480.032771] Lustre: Skipped 10 previous similar messages [ 480.059911] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:195 to 0x280000400:225 [ 480.060422] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:91 to 0x2c0000400:193 [ 482.784556] Lustre: DEBUG MARKER: oleg138-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid [ 483.840455] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 485.783462] Lustre: *** cfs_fail_loc=194, val=0*** [ 485.785072] Lustre: 6898:0:(osd_handler.c:890:osd_check_lma()) lustre-MDT0001: unsupported incompat LMA feature(s) 0x0 for fid = [0x240000402:0x3fc:0x0], ino = 512155 [ 490.080488] Lustre: DEBUG MARKER: == sanity test 18: touch .../f ; ls ... ======================================================================================== 02:17:07 (1713507427) [ 493.769310] Lustre: DEBUG MARKER: == sanity test 19a: touch .../f19 ; ls -l ... ; rm .../f19 ===================================================================== 02:17:10 (1713507430) [ 498.563479] Lustre: DEBUG MARKER: == sanity test 19b: ls -l .../f19 (should return error) ======================================================================== 02:17:15 (1713507435) [ 502.402274] Lustre: DEBUG MARKER: == sanity test 19c: runas -u 500 -g 500 touch .../f19 (should return error) ============================================================ 02:17:19 (1713507439) [ 506.467207] Lustre: DEBUG MARKER: == sanity test 19d: cat .../f19 (should return error) ======================================================================== 02:17:23 (1713507443) [ 510.463550] Lustre: DEBUG MARKER: == sanity test 20: touch .../f ; ls -l ... =============== 02:17:27 (1713507447) [ 515.227308] Lustre: DEBUG MARKER: == sanity test 21: write to dangling link ================ 02:17:32 (1713507452) [ 519.372423] Lustre: DEBUG MARKER: == sanity test 22: unpack tar archive as non-root user === 02:17:36 (1713507456) [ 523.890001] Lustre: DEBUG MARKER: == sanity test 23a: O_CREAT|O_EXCL in subdir ============= 02:17:40 (1713507460) [ 528.121883] Lustre: DEBUG MARKER: == sanity test 23b: O_APPEND check ======================= 02:17:45 (1713507465) [ 532.743442] Lustre: DEBUG MARKER: == sanity test 23c: O_APPEND size checks for tiny writes ========================================================== 02:17:49 (1713507469) [ 539.345528] Lustre: DEBUG MARKER: == sanity test 23d: file offset is correct after appending writes ========================================================== 02:17:56 (1713507476) [ 543.459631] Lustre: DEBUG MARKER: == sanity test 24a: rename file to non-existent target === 02:18:00 (1713507480) [ 547.297061] Lustre: DEBUG MARKER: == sanity test 24b: rename file to existing target ======= 02:18:04 (1713507484) [ 551.587020] Lustre: DEBUG MARKER: == sanity test 24c: rename directory to non-existent target ========================================================== 02:18:08 (1713507488) [ 555.233931] Lustre: DEBUG MARKER: == sanity test 24d: rename directory to existing target == 02:18:12 (1713507492) [ 558.540579] Lustre: DEBUG MARKER: == sanity test 24e: touch .../R5a/f; rename .../R5a/f .../R5b/g ================================================================ 02:18:15 (1713507495) [ 561.461462] Lustre: DEBUG MARKER: == sanity test 24f: touch .../R6a/f R6b/g; mv .../R6a/f .../R6b/g ============================================================== 02:18:18 (1713507498) [ 564.452793] Lustre: DEBUG MARKER: == sanity test 24g: mkdir .../R7a/d; .../R7b/d; mv .../R7a/d .../R7b/e ================================================================ 02:18:21 (1713507501) [ 568.562121] Lustre: DEBUG MARKER: == sanity test 24h: mkdir .../R8a/d; .../R8a/e; .../R8b/d; .../R8b/e; rename .../R8a/d .../R8b/e ========================================================== 02:18:25 (1713507505) [ 573.969939] Lustre: DEBUG MARKER: == sanity test 24i: rename file to dir error: touch f ; mkdir a ; rename f a ========================================================== 02:18:30 (1713507510) [ 578.795464] Lustre: DEBUG MARKER: == sanity test 24j: source does not exist ====================================================================================== 02:18:35 (1713507515) [ 583.350431] Lustre: DEBUG MARKER: == sanity test 24k: touch .../R11a/f; mv .../R11a/f .../R11a/d ================================================================= 02:18:40 (1713507520) [ 587.121574] Lustre: DEBUG MARKER: == sanity test 24l: Renaming a file to itself ================================================================================== 02:18:44 (1713507524) [ 590.502593] Lustre: DEBUG MARKER: == sanity test 24m: Renaming a file to a hard link to itself =================================================================== 02:18:47 (1713507527) [ 594.252951] Lustre: DEBUG MARKER: == sanity test 24n: Statting the old file after renaming (Posix rename 2) ========================================================== 02:18:51 (1713507531) [ 599.000497] Lustre: DEBUG MARKER: == sanity test 24o: rename of files during htree split === 02:18:55 (1713507535) [ 718.253225] Lustre: DEBUG MARKER: == sanity test 24p: mkdir .../R12a; .../R12b; rename .../R12a .../R12b ========================================================== 02:20:55 (1713507655) [ 719.781602] Lustre: DEBUG MARKER: == sanity test 24q: mkdir .../R13a; .../R13b; open R13b rename R13a R13b ============================================================= 02:20:57 (1713507657) [ 721.317016] Lustre: DEBUG MARKER: == sanity test 24r: mkdir .../R14a/b; rename .../R14a .../R14a/b =============================================================== 02:20:58 (1713507658) [ 722.848992] Lustre: DEBUG MARKER: == sanity test 24s: mkdir .../R15a/b/c; rename .../R15a .../R15a/b/c =========================================================== 02:21:00 (1713507660) [ 724.439816] Lustre: DEBUG MARKER: == sanity test 24t: mkdir .../R16a/b/c; rename .../R16a/b/c .../R16a =========================================================== 02:21:01 (1713507661) [ 726.255814] Lustre: DEBUG MARKER: == sanity test 24u: create stripe file =================== 02:21:03 (1713507663) [ 727.889257] Lustre: DEBUG MARKER: == sanity test 24v: list large directory (test hash collision, b=17560) ========================================================== 02:21:05 (1713507665) [ 1190.615672] Lustre: DEBUG MARKER: == sanity test 24w: Reading a file larger than 4Gb ======= 02:28:48 (1713508128) [ 1192.808336] Lustre: DEBUG MARKER: == sanity test 24x: cross MDT rename/link ================ 02:28:50 (1713508130) [ 1195.121959] Lustre: DEBUG MARKER: == sanity test 24y: rename/link on the same dir should succeed ========================================================== 02:28:52 (1713508132) [ 1197.239254] Lustre: DEBUG MARKER: == sanity test 24z: cross-MDT rename is done as cp ======= 02:28:54 (1713508134) [ 1200.430776] Lustre: DEBUG MARKER: == sanity test 24A: readdir() returns correct number of entries. ========================================================== 02:28:57 (1713508137) [ 1218.953955] Lustre: DEBUG MARKER: == sanity test 24B: readdir for striped dir return correct number of entries ========================================================== 02:29:16 (1713508156) [ 1220.770873] Lustre: DEBUG MARKER: == sanity test 24C: check .. in striped dir ============== 02:29:18 (1713508158) [ 1223.174510] Lustre: DEBUG MARKER: == sanity test 24E: cross MDT rename/link ================ 02:29:20 (1713508160) [ 1223.558237] Lustre: DEBUG MARKER: SKIP: sanity test_24E needs >= 4 MDTs [ 1223.953317] Lustre: DEBUG MARKER: == sanity test 24F: hash order vs readdir (LU-11330) ===== 02:29:21 (1713508161) [ 1237.325638] Lustre: DEBUG MARKER: == sanity test 24G: migrate symlink in rename ============ 02:29:34 (1713508174) [ 1239.303878] Lustre: DEBUG MARKER: == sanity test 24H: repeat FLD_QUERY rpc ================= 02:29:36 (1713508176) [ 1241.401745] Lustre: DEBUG MARKER: == sanity test 25a: create file in symlinked directory ========================================================================= 02:29:38 (1713508178) [ 1243.064224] Lustre: DEBUG MARKER: == sanity test 25b: lookup file in symlinked directory ========================================================================= 02:29:40 (1713508180) [ 1245.020988] Lustre: DEBUG MARKER: == sanity test 26a: multiple component symlink ================================================================================= 02:29:42 (1713508182) [ 1247.053615] Lustre: DEBUG MARKER: == sanity test 26b: multiple component symlink at end of lookup ================================================================ 02:29:44 (1713508184) [ 1248.883512] Lustre: DEBUG MARKER: == sanity test 26c: chain of symlinks ==================== 02:29:46 (1713508186) [ 1250.358330] Lustre: DEBUG MARKER: == sanity test 26d: create multiple component recursive symlink ========================================================== 02:29:47 (1713508187) [ 1251.787925] Lustre: DEBUG MARKER: == sanity test 26e: unlink multiple component recursive symlink ========================================================== 02:29:49 (1713508189) [ 1253.186011] Lustre: DEBUG MARKER: == sanity test 26f: rm -r of a directory which has recursive symlink ========================================================== 02:29:50 (1713508190) [ 1254.915124] Lustre: DEBUG MARKER: == sanity test 27a: one stripe file ====================== 02:29:52 (1713508192) [ 1256.439955] Lustre: DEBUG MARKER: == sanity test 27b: create and write to two stripe file == 02:29:53 (1713508193) [ 1257.882021] Lustre: DEBUG MARKER: == sanity test 27ca: one stripe on specified OST ========= 02:29:55 (1713508195) [ 1259.576173] Lustre: DEBUG MARKER: == sanity test 27cb: two stripes on specified OSTs ======= 02:29:57 (1713508197) [ 1261.868996] Lustre: DEBUG MARKER: == sanity test 27cc: two stripes on the same OST ========= 02:29:59 (1713508199) [ 1264.402234] Lustre: DEBUG MARKER: == sanity test 27cd: four stripes on two OSTs ============ 02:30:01 (1713508201) [ 1266.843367] Lustre: DEBUG MARKER: == sanity test 27ce: more stripes than OSTs with -o ====== 02:30:04 (1713508204) [ 1269.399004] Lustre: DEBUG MARKER: == sanity test 27cf: 'setstripe -o' on inactive OSTs should return error ========================================================== 02:30:06 (1713508206) [ 1269.778519] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 1271.482870] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1271.490803] Lustre: Skipped 9 previous similar messages [ 1271.493913] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 1271.498973] LustreError: 167-0: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 1271.507923] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to (at 0@lo) [ 1271.508197] Lustre: lustre-OST0000: deleting orphan objects from 0x0:262 to 0x0:289 [ 1271.508592] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:240 to 0x280000400:257 [ 1271.521057] Lustre: Skipped 3 previous similar messages [ 1274.087960] Lustre: DEBUG MARKER: == sanity test 27d: create file with default settings ==== 02:30:11 (1713508211) [ 1276.240266] Lustre: DEBUG MARKER: == sanity test 27e: setstripe existing file (should return error) ========================================================== 02:30:13 (1713508213) [ 1278.549740] Lustre: DEBUG MARKER: == sanity test 27f: setstripe with bad stripe size (should return error) ========================================================== 02:30:15 (1713508215) [ 1280.685003] Lustre: DEBUG MARKER: == sanity test 27g: /home/green/git/lustre-release/lustre/utils/lfs getstripe with no objects ========================================================== 02:30:18 (1713508218) [ 1282.930804] Lustre: DEBUG MARKER: == sanity test 27ga: /home/green/git/lustre-release/lustre/utils/lfs getstripe with missing file (should return error) ========================================================== 02:30:20 (1713508220) [ 1284.601816] Lustre: DEBUG MARKER: == sanity test 27i: /home/green/git/lustre-release/lustre/utils/lfs getstripe with some objects ========================================================== 02:30:22 (1713508222) [ 1286.108120] Lustre: DEBUG MARKER: == sanity test 27j: setstripe with bad stripe offset (should return error) ========================================================== 02:30:23 (1713508223) [ 1287.632878] Lustre: DEBUG MARKER: == sanity test 27k: limit i_blksize for broken user apps ========================================================== 02:30:25 (1713508225) [ 1289.265776] Lustre: DEBUG MARKER: == sanity test 27l: check setstripe permissions (should return error) ========================================================== 02:30:26 (1713508226) [ 1290.702195] Lustre: DEBUG MARKER: SKIP: sanity test_27m skipping SLOW test 27m [ 1291.073077] Lustre: DEBUG MARKER: == sanity test 27n: create file with some full OSTs ====== 02:30:28 (1713508228) [ 1295.398212] Lustre: *** cfs_fail_loc=215, val=0*** [ 1309.851093] Lustre: DEBUG MARKER: == sanity test 27o: create file with all full OSTs (should error) ========================================================== 02:30:47 (1713508247) [ 1316.442064] Lustre: *** cfs_fail_loc=215, val=1*** [ 1317.114086] Lustre: *** cfs_fail_loc=215, val=1*** [ 1317.115289] Lustre: Skipped 2 previous similar messages [ 1320.477125] Lustre: *** cfs_fail_loc=215, val=0*** [ 1320.478556] Lustre: Skipped 5 previous similar messages [ 1321.450273] Lustre: *** cfs_fail_loc=215, val=1*** [ 1329.809077] Lustre: DEBUG MARKER: == sanity test 27oo: don't let few threads to reserve too many objects ========================================================== 02:31:07 (1713508267) [ 1349.823923] Lustre: Failing over lustre-OST0000 [ 1349.825130] Lustre: Skipped 2 previous similar messages [ 1349.828655] LustreError: 31486:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 1349.830818] LustreError: 31486:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 2 previous similar messages [ 1349.841093] Lustre: server umount lustre-OST0000 complete [ 1351.641911] LustreError: 11-0: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1351.641922] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1351.641923] Lustre: Skipped 1 previous similar message [ 1351.642110] LustreError: 137-5: lustre-OST0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1351.642111] LustreError: Skipped 20 previous similar messages [ 1351.655034] LustreError: Skipped 2 previous similar messages [ 1353.259662] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 1353.263396] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1353.300959] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1353.305569] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1353.413372] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1354.156298] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 1354.937583] Lustre: lustre-OST0000: Recovery over after 0:02, of 3 clients 3 recovered and 0 were evicted. [ 1354.937612] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 192.168.201.138@tcp (at 0@lo) [ 1354.939106] Lustre: lustre-OST0000: deleting orphan objects from 0x0:336 to 0x0:353 [ 1354.939422] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:299 to 0x280000400:321 [ 1354.950217] Lustre: Skipped 1 previous similar message [ 1355.381746] Lustre: DEBUG MARKER: == sanity test 27p: append to a truncated file with some full OSTs ========================================================== 02:31:32 (1713508292) [ 1369.962203] Lustre: *** cfs_fail_loc=215, val=0*** [ 1369.964224] Lustre: Skipped 3 previous similar messages [ 1383.126559] Lustre: DEBUG MARKER: == sanity test 27q: append to truncated file with all OSTs full (should error) ========================================================== 02:32:00 (1713508320) [ 1387.226221] Lustre: *** cfs_fail_loc=215, val=1*** [ 1390.080675] LustreError: 25063:0:(lod_qos.c:1362:lod_ost_alloc_specific()) can't lstripe objid [0x200000402:0xf991:0x0]: have 0 want 1 [ 1396.570069] Lustre: *** cfs_fail_loc=215, val=1*** [ 1396.571331] Lustre: Skipped 6 previous similar messages [ 1400.605837] Lustre: *** cfs_fail_loc=215, val=0*** [ 1407.171825] Lustre: DEBUG MARKER: == sanity test 27r: stripe file with some full OSTs (shouldn't LBUG) =========================================================== 02:32:24 (1713508344) [ 1415.034109] Lustre: *** cfs_fail_loc=215, val=0*** [ 1415.035667] Lustre: Skipped 2 previous similar messages [ 1426.933606] Lustre: DEBUG MARKER: == sanity test 27s: lsm_xfersize overflow (should error) (bug 10725) ========================================================== 02:32:44 (1713508364) [ 1428.532897] Lustre: DEBUG MARKER: == sanity test 27t: check that utils parse path correctly ========================================================== 02:32:46 (1713508366) [ 1430.433615] Lustre: DEBUG MARKER: == sanity test 27u: skip object creation on OSC w/o objects ========================================================== 02:32:47 (1713508367) [ 1431.719867] Lustre: *** cfs_fail_loc=139, val=0*** [ 1432.221741] Lustre: *** cfs_fail_loc=139, val=0*** [ 1432.224071] Lustre: Skipped 310 previous similar messages [ 1433.222821] Lustre: *** cfs_fail_loc=139, val=0*** [ 1433.224661] Lustre: Skipped 753 previous similar messages [ 1451.685866] Lustre: DEBUG MARKER: == sanity test 27v: skip object creation on slow OST ===== 02:33:09 (1713508389) [ 1455.098095] Lustre: *** cfs_fail_loc=215, val=0*** [ 1455.100877] Lustre: Skipped 1 previous similar message [ 1486.964618] Lustre: DEBUG MARKER: == sanity test 27w: check /home/green/git/lustre-release/lustre/utils/lfs setstripe -S and getstrip -d options ========================================================== 02:33:44 (1713508424) [ 1488.636402] Lustre: DEBUG MARKER: == sanity test 27wa: check /home/green/git/lustre-release/lustre/utils/lfs setstripe -c -i options ========================================================== 02:33:46 (1713508426) [ 1490.311784] Lustre: DEBUG MARKER: == sanity test 27x: create files while OST0 is degraded == 02:33:47 (1713508427) [ 1503.543952] Lustre: DEBUG MARKER: == sanity test 27y: create files while OST0 is degraded and the rest inactive ========================================================== 02:34:00 (1713508440) [ 1504.887021] Lustre: setting import lustre-OST0001_UUID INACTIVE by administrator request [ 1504.888493] Lustre: Skipped 1 previous similar message [ 1517.471273] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1517.480724] Lustre: Skipped 1 previous similar message [ 1517.484085] Lustre: lustre-OST0001: Client lustre-MDT0001-mdtlov_UUID (at 0@lo) reconnecting [ 1517.488161] Lustre: Skipped 1 previous similar message [ 1517.490873] LustreError: 167-0: lustre-OST0001-osc-MDT0001: This client was evicted by lustre-OST0001; in progress operations using this service will fail. [ 1517.494459] LustreError: Skipped 1 previous similar message [ 1517.496039] Lustre: lustre-OST0001-osc-MDT0001: Connection restored to 192.168.201.138@tcp (at 0@lo) [ 1517.496201] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:776 to 0x2c0000400:801 [ 1517.504658] Lustre: Skipped 1 previous similar message [ 1517.731789] Lustre: lustre-OST0001: deleting orphan objects from 0x0:771 to 0x0:801 [ 1530.251303] Lustre: DEBUG MARKER: == sanity test 27z: check SEQ/OID on the MDT and OST filesystems ========================================================== 02:34:27 (1713508467) [ 1535.862493] Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-1 [ 1536.203253] Lustre: DEBUG MARKER: FID seq 0x200000402, oid 0xfbc0 ver 0x0 [ 1536.537028] Lustre: DEBUG MARKER: LOV seq 0x200000402, oid 0xfbc0, count: 1 [ 1536.935326] Lustre: DEBUG MARKER: want: stripe:0 ost:0 oid:452/0x1c4 seq:0 [ 1537.507232] Lustre: DEBUG MARKER: check file /mnt/lustre/d27z.sanity/f27z.sanity-2 [ 1537.845357] Lustre: DEBUG MARKER: FID seq 0x240000402, oid 0xd471 ver 0x0 [ 1538.222144] Lustre: DEBUG MARKER: LOV seq 0x240000402, oid 0xd471, count: 2 [ 1538.756921] Lustre: DEBUG MARKER: want: stripe:0 ost:1 oid:802/0x322 seq:0x2c0000400 [ 1539.505439] Lustre: DEBUG MARKER: want: stripe:1 ost:0 oid:395/0x18b seq:0x280000400 [ 1541.151536] Lustre: DEBUG MARKER: == sanity test 27A: check filesystem-wide default LOV EA values ========================================================== 02:34:38 (1713508478) [ 1543.314623] Lustre: DEBUG MARKER: == sanity test 27B: call setstripe on open unlinked file/rename victim ========================================================== 02:34:40 (1713508480) [ 1545.554463] Lustre: DEBUG MARKER: == sanity test 27Ca: check full striping across all OSTs ========================================================== 02:34:43 (1713508483) [ 1547.631194] Lustre: DEBUG MARKER: == sanity test 27Cb: more stripes than OSTs with -C ====== 02:34:45 (1713508485) [ 1550.124518] Lustre: DEBUG MARKER: == sanity test 27Cc: fewer stripes than OSTs does not set overstriping ========================================================== 02:34:47 (1713508487) [ 1552.587294] Lustre: DEBUG MARKER: == sanity test 27Cd: test maximum stripe count =========== 02:34:49 (1713508489) [ 1553.841910] Lustre: 9330:0:(osd_handler.c:1948:osd_trans_start()) lustre-MDT0001: credits 128189 > trans_max 3200 [ 1553.844590] Lustre: 9330:0:(osd_handler.c:1877:osd_trans_dump_creds()) create: 2000/8000/0, destroy: 1/4/0 [ 1553.847081] Lustre: 9330:0:(osd_handler.c:1884:osd_trans_dump_creds()) attr_set: 3/3/0, xattr_set: 2004/148/0 [ 1553.850974] Lustre: 9330:0:(osd_handler.c:1894:osd_trans_dump_creds()) write: 10001/86010/0, punch: 0/0/0, quota 0/0/0 [ 1553.855012] Lustre: 9330:0:(osd_handler.c:1901:osd_trans_dump_creds()) insert: 2001/34016/0, delete: 2/5/0 [ 1553.858437] Lustre: 9330:0:(osd_handler.c:1908:osd_trans_dump_creds()) ref_add: 1/1/0, ref_del: 2/2/0 [ 1553.862239] Pid: 9330, comm: mdt00_003 3.10.0-7.9-debug #1 SMP Sat Mar 26 23:28:42 EDT 2022 [ 1553.864714] Call Trace: [ 1553.865321] [<0>] libcfs_call_trace+0x90/0xf0 [libcfs] [ 1553.867066] [<0>] libcfs_debug_dumpstack+0x26/0x30 [libcfs] [ 1553.868723] [<0>] osd_trans_start+0x5ba/0x5e0 [osd_ldiskfs] [ 1553.869941] [<0>] top_trans_start+0x763/0xa10 [ptlrpc] [ 1553.872179] [<0>] lod_trans_start+0x34/0x40 [lod] [ 1553.873340] [<0>] mdd_trans_start+0x14/0x20 [mdd] [ 1553.874483] [<0>] mdd_unlink+0x5e3/0xdb0 [mdd] [ 1553.875555] [<0>] mdt_reint_unlink+0xe32/0x1df0 [mdt] [ 1553.876622] [<0>] mdt_reint_rec+0x87/0x240 [mdt] [ 1553.877712] [<0>] mdt_reint_internal+0x76c/0xb50 [mdt] [ 1553.878922] [<0>] mdt_reint+0x67/0x150 [mdt] [ 1553.879911] [<0>] tgt_request_handle+0x93a/0x19c0 [ptlrpc] [ 1553.881772] [<0>] ptlrpc_server_handle_request+0x250/0xc30 [ptlrpc] [ 1553.884169] [<0>] ptlrpc_main+0xbd9/0x15f0 [ptlrpc] [ 1553.885493] [<0>] kthread+0xe4/0xf0 [ 1553.886284] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [ 1553.887495] [<0>] 0xfffffffffffffffe [ 1553.888539] Lustre: 9330:0:(osd_internal.h:1333:osd_trans_exec_op()) lustre-MDT0001: opcode 7: before 3203 < left 86010, rollback = 7 [ 1556.369702] Lustre: DEBUG MARKER: == sanity test 27Ce: test pool with overstriping ========= 02:34:53 (1713508493) [ 1561.135690] LustreError: 14596:0:(qmt_pool.c:1406:qmt_pool_add_rem()) add to: can't lustre-QMT0000 lustre-OST0000_UUID pool test_27Ce: rc = -17 [ 1566.083830] LustreError: 15135:0:(qmt_pool.c:1406:qmt_pool_add_rem()) remove: can't lustre-QMT0000 lustre-OST0000_UUID pool test_27Ce: rc = -22 [ 1568.426902] Lustre: DEBUG MARKER: == sanity test 27Cf: test default inheritance with overstriping ========================================================== 02:35:05 (1713508505) [ 1569.936998] Lustre: DEBUG MARKER: == sanity test 27D: validate llapi_layout API ============ 02:35:07 (1713508507) [ 1573.323567] LustreError: 16014:0:(qmt_pool.c:1406:qmt_pool_add_rem()) add to: can't lustre-QMT0000 lustre-OST0000_UUID pool testpool: rc = -17 [ 1577.532832] LustreError: 16360:0:(qmt_pool.c:1406:qmt_pool_add_rem()) remove: can't lustre-QMT0000 lustre-OST0000_UUID pool testpool: rc = -22 [ 1577.535339] LustreError: 16360:0:(qmt_pool.c:1406:qmt_pool_add_rem()) Skipped 1 previous similar message [ 1584.521446] Lustre: DEBUG MARKER: == sanity test 27E: check that default extended attribute size properly increases ========================================================== 02:35:21 (1713508521) [ 1586.317253] Lustre: DEBUG MARKER: == sanity test 27F: Client resend delayed layout creation with non-zero size ========================================================== 02:35:23 (1713508523) [ 1586.956785] Lustre: Failing over lustre-OST0000 [ 1586.960908] LustreError: 17366:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items [ 1586.962750] LustreError: 17366:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 2 previous similar messages [ 1586.972763] Lustre: server umount lustre-OST0000 complete [ 1590.971924] LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5 [ 1590.978964] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1591.100822] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1591.105300] Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1591.106571] Lustre: lustre-OST0000: in recovery but waiting for the first client to connect [ 1591.108093] Lustre: lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 1591.116780] Lustre: Skipped 3 previous similar messages [ 1591.118377] LustreError: 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1591.124435] LustreError: Skipped 3 previous similar messages [ 1592.358677] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 1593.219364] Lustre: lustre-OST0000: Recovery over after 0:02, of 3 clients 3 recovered and 0 were evicted. [ 1593.219464] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to (at 0@lo) [ 1593.219467] Lustre: Skipped 1 previous similar message [ 1593.220977] Lustre: lustre-OST0000: deleting orphan objects from 0x280000400:1413 to 0x280000400:1441 [ 1595.358297] LDISKFS-fs (dm-3): file extents enabled, maximum tree depth=5 [ 1595.365734] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1595.440132] Lustre: lustre-OST0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [ 1595.448745] Lustre: lustre-OST0001: in recovery but waiting for the first client to connect [ 1596.432767] Lustre: 3347:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1713508526/real 1713508526] req@ffff88008fc017c0 x1796742321370112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 1 dl 1713508533 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u8:0.0' [ 1596.446718] Lustre: 3347:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 1596.869255] Lustre: DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 [ 1597.474157] Lustre: lustre-OST0001: deleting orphan objects from 0x0:811 to 0x0:833 [ 1597.479591] Lustre: lustre-OST0001: deleting orphan objects from 0x2c0000400:1823 to 0x2c0000400:1857 [ 1600.698913] Lustre: 6897:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1713508526/real 1713508526] req@ffff88008fc03440 x1796742321370560/t0(0) o10->lustre-OST0001-osc-MDT0000@0@lo:6/4 lens 440/432 e 0 to 1 dl 1713508538 ref 2 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'mdt00_000.0' [ 1600.713220] Lustre: 6897:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 1600.717941] LustreError: 6897:0:(osp_precreate.c:1706:osp_object_truncate()) can't punch object: -107 [ 1600.725670] Lustre: lustre-OST0000: deleting orphan objects from 0x0:459 to 0x0:481 [ 1600.731412] Lustre: lustre-MDT0000: Client c29815ae-77c6-4292-a9aa-c8b53e8ce2f3 (at 192.168.201.38@tcp) reconnecting [ 1600.738537] Lustre: Skipped 1 previous similar message [ 1602.894022] Lustre: DEBUG MARKER: == sanity test 27G: Clear OST pool from stripe =========== 02:35:40 (1713508540) [ 1608.433879] LustreError: 20172:0:(qmt_pool.c:1406:qmt_pool_add_rem()) add to: can't lustre-QMT0000 lustre-OST0000_UUID pool testpool: rc = -17 [ 1608.441493] LustreError: 20172:0:(qmt_pool.c:1406:qmt_pool_add_rem()) Skipped 1 previous similar message [ 1616.666582] Lustre: DEBUG MARKER: == sanity test 27H: Set specific OSTs stripe ============= 02:35:54 (1713508554) [ 1617.023273] Lustre: DEBUG MARKER: SKIP: sanity test_27H needs >= 3 OSTs [ 1617.418453] Lustre: DEBUG MARKER: == sanity test 27I: check that root dir striping does not break parent dir one ========================================================== 02:35:54 (1713508554) [ 1622.012110] LustreError: 21459:0:(qmt_pool.c:1406:qmt_pool_add_rem()) add to: can't lustre-QMT0000 lustre-OST0001_UUID pool test_27I: rc = -17 [ 1622.017881] LustreError: 21459:0:(qmt_pool.c:1406:qmt_pool_add_rem()) Skipped 1 previous similar message [ 1631.511792] Lustre: DEBUG MARKER: == sanity test 27J: basic ops on file with foreign LOV === 02:36:09 (1713508569) [ 1633.116546] Lustre: DEBUG MARKER: == sanity test 27K: basic ops on dir with foreign LMV ==== 02:36:10 (1713508570) [ 1634.670520] Lustre: DEBUG MARKER: == sanity test 27L: lfs pool_list gives correct pool name ========================================================== 02:36:12 (1713508572) [ 1642.458131] Lustre: DEBUG MARKER: == sanity test 27M: test O_APPEND striping =============== 02:36:19 (1713508579) [ 1650.046306] LustreError: 24461:0:(qmt_pool.c:1406:qmt_pool_add_rem()) add to: can't lustre-QMT0000 lustre-OST0000_UUID pool test_27M: rc = -17 [ 1650.052543] LustreError: 24461:0:(qmt_pool.c:1406:qmt_pool_add_rem()) Skipped 1 previous similar message [ 1663.191223] Lustre: DEBUG MARKER: == sanity test 27N: lctl pool_list on separate MGS gives correct pool name ========================================================== 02:36:40 (1713508600) [ 1663.802138] Lustre: DEBUG MARKER: SKIP: sanity test_27N needs separate MGS/MDT [ 1664.458249] Lustre: DEBUG MARKER: == sanity test 27O: basic ops on foreign file of symlink type ========================================================== 02:36:41 (1713508601) [ 1667.522722] Lustre: DEBUG MARKER: == sanity test 27P: basic ops on foreign dir of foreign_symlink type ========================================================== 02:36:44 (1713508604) [ 1670.583769] Lustre: DEBUG MARKER: == sanity test 27Q: llapi_file_get_stripe() works on symlinks ========================================================== 02:36:47 (1713508607) [ 1673.180416] Lustre: DEBUG MARKER: == sanity test 27R: test max_stripecount limitation when stripe count is set to -1 ========================================================== 02:36:50 (1713508610) [ 1676.915055] Lustre: DEBUG MARKER: == sanity test 27S: don't deactivate OSP on network issue ========================================================== 02:36:54 (1713508614) [ 1677.492035] Lustre: DEBUG MARKER: SKIP: sanity test_27S needs different host for mdt1 ost1 [ 1678.157857] Lustre: DEBUG MARKER: == sanity test 27T: no eio on close on partial write due to enosp ========================================================== 02:36:55 (1713508615) [ 1678.689141] Lustre: *** cfs_fail_loc=215, val=0*** [ 1681.026389] Lustre: DEBUG MARKER: == sanity test 28: create/mknod/mkdir with bad file types ====================================================================== 02:36:58 (1713508618) [ 1683.832544] Lustre: DEBUG MARKER: == sanity test 29: IT_GETATTR regression ====================================================================================== 02:37:01 (1713508621) [ 1685.731315] Lustre: DEBUG MARKER: first d29 [ 1686.204863] Lustre: DEBUG MARKER: second d29 [ 1686.786439] Lustre: DEBUG MARKER: done [ 1689.161732] Lustre: DEBUG MARKER: == sanity test 30a: execute binary from Lustre (execve) ======================================================================== 02:37:06 (1713508626) [ 1691.535730] Lustre: DEBUG MARKER: == sanity test 30b: execute binary from Lustre as non-root ===================================================================== 02:37:08 (1713508628) [ 1693.924944] Lustre: DEBUG MARKER: == sanity test 30c: execute binary from Lustre without read perms ============================================================== 02:37:11 (1713508631) [ 1696.420353] Lustre: DEBUG MARKER: == sanity test 30d: execute binary from Lustre while clear locks ========================================================== 02:37:13 (1713508633) [ 1732.678624] Lustre: DEBUG MARKER: == sanity test 31a: open-unlink file ============================================================================================ 02:37:50 (1713508670) [ 1735.080428] Lustre: DEBUG MARKER: == sanity test 31b: unlink file with multiple links while open ================================================================= 02:37:52 (1713508672) [ 1737.448268] Lustre: DEBUG MARKER: == sanity test 31c: open-unlink file with multiple links ======================================================================= 02:37:54 (1713508674) [ 1739.796869] Lustre: DEBUG MARKER: == sanity test 31d: remove of open directory =================================================================================== 02:37:57 (1713508677) [ 1742.077486] Lustre: DEBUG MARKER: == sanity test 31e: remove of open non-empty directory ========================================================================= 02:37:59 (1713508679) [ 1744.457622] Lustre: DEBUG MARKER: == sanity test 31f: remove of open directory with open-unlink file ============================================================= 02:38:01 (1713508681) [ 1753.167034] Lustre: DEBUG MARKER: == sanity test 31g: cross directory link================== 02:38:10 (1713508690) [ 1755.677628] Lustre: DEBUG MARKER: == sanity test 31h: cross directory link under child========================================================================= 02:38:13 (1713508693) [ 1758.113246] Lustre: DEBUG MARKER: == sanity test 31i: cross directory link under parent========================================================================= 02:38:15 (1713508695) [ 1760.646909] Lustre: DEBUG MARKER: == sanity test 31j: link for directory==================== 02:38:17 (1713508697) [ 1763.123006] Lustre: DEBUG MARKER: == sanity test 31k: link to file: the same, non-existing, dir========================================================================= 02:38:20 (1713508700) [ 1765.462062] Lustre: DEBUG MARKER: == sanity test 31m: link to file: the same, non-existing, dir========================================================================= 02:38:22 (1713508702) [ 1767.952153] Lustre: DEBUG MARKER: == sanity test 31n: check link count of unlinked file ==== 02:38:25 (1713508705) [ 1770.338352] Lustre: DEBUG MARKER: == sanity test 31o: duplicate hard links with same filename ========================================================== 02:38:27 (1713508707) [ 1786.834266] Lustre: DEBUG MARKER: == sanity test 31p: remove of open striped directory ===== 02:38:44 (1713508724) [ 1789.397464] Lustre: DEBUG MARKER: == sanity test 31q: create striped directory on specific MDTs ========================================================== 02:38:46 (1713508726) [ 1789.924264] Lustre: DEBUG MARKER: SKIP: sanity test_31q needs >= 3 MDTs [ 1790.539586] Lustre: DEBUG MARKER: == sanity test 31r: open-rename(replace) race ============ 02:38:47 (1713508727) [ 1796.007521] Lustre: DEBUG MARKER: == sanity test 32a: stat d32a/ext2-mountpoint/.. =============================================================================== 02:38:53 (1713508733) [ 1798.163386] Lustre: DEBUG MARKER: == sanity test 32b: open d32b/ext2-mountpoint/.. =============================================================================== 02:38:55 (1713508735) [ 1799.715175] Lustre: DEBUG MARKER: == sanity test 32c: stat d32c/ext2-mountpoint/../d2/test_dir =================================================================== 02:38:57 (1713508737) [ 1801.361442] Lustre: DEBUG MARKER: == sanity test 32d: open d32d/ext2-mountpoint/../d2/test_dir ========================================================== 02:38:58 (1713508738) [ 1803.267146] Lustre: DEBUG MARKER: == sanity test 32e: stat d32e/symlink->tmp/symlink->lustre-subdir ========================================================== 02:39:00 (1713508740) [ 1804.956791] Lustre: DEBUG MARKER: == sanity test 32f: open d32f/symlink->tmp/symlink->lustre-subdir ========================================================== 02:39:02 (1713508742) [ 1806.570936] Lustre: DEBUG MARKER: == sanity test 32g: stat d32g/symlink->tmp/symlink->lustre-subdir/2 ========================================================== 02:39:04 (1713508744) [ 1808.221123] Lustre: DEBUG MARKER: == sanity test 32h: open d32h/symlink->tmp/symlink->lustre-subdir/2 ========================================================== 02:39:05 (1713508745) [ 1809.952771] Lustre: DEBUG MARKER: == sanity test 32i: stat d32i/ext2-mountpoint/../test_file ===================================================================== 02:39:07 (1713508747) [ 1811.841915] Lustre: DEBUG MARKER: == sanity test 32j: open d32j/ext2-mountpoint/../test_file ===================================================================== 02:39:09 (1713508749) [ 1813.563053] Lustre: DEBUG MARKER: == sanity test 32k: stat d32k/ext2-mountpoint/../d2/test_file ================================================================== 02:39:11 (1713508751) [ 1815.757948] Lustre: DEBUG MARKER: == sanity test 32l: open d32l/ext2-mountpoint/../d2/test_file ================================================================== 02:39:13 (1713508753) [ 1817.528202] Lustre: DEBUG MARKER: == sanity test 32m: stat d32m/symlink->tmp/symlink->lustre-root ================================================================ 02:39:15 (1713508755) [ 1819.555101] Lustre: DEBUG MARKER: == sanity test 32n: open d32n/symlink->tmp/symlink->lustre-root ================================================================ 02:39:17 (1713508757) [ 1821.805084] Lustre: DEBUG MARKER: == sanity test 32o: stat d32o/symlink->tmp/symlink->lustre-root/ ========================================================== 02:39:19 (1713508759) [ 1824.178220] Lustre: DEBUG MARKER: == sanity test 32p: open d32p/symlink->tmp/symlink->lustre-root/ ========================================================== 02:39:21 (1713508761) [ 1824.720373] Lustre: DEBUG MARKER: 32p_1 [ 1825.274750] Lustre: DEBUG MARKER: 32p_2 [ 1825.840345] Lustre: DEBUG MARKER: 32p_3 [ 1826.428435] Lustre: DEBUG MARKER: 32p_4 [ 1827.066802] Lustre: DEBUG MARKER: 32p_5 [ 1827.607626] Lustre: DEBUG MARKER: 32p_6 [ 1828.158943] Lustre: DEBUG MARKER: 32p_7 [ 1828.591141] Lustre: DEBUG MARKER: 32p_8 [ 1829.119749] Lustre: DEBUG MARKER: 32p_9 [ 1829.703435] Lustre: DEBUG MARKER: 32p_10 [ 1832.135068] Lustre: DEBUG MARKER: == sanity test 32q: stat follows mountpoints in Lustre (should return error) ========================================================== 02:39:29 (1713508769) [ 1834.559451] Lustre: DEBUG MARKER: == sanity test 32r: opendir follows mountpoints in Lustre (should return error) ========================================================== 02:39:31 (1713508771) [ 1837.140693] Lustre: DEBUG MARKER: == sanity test 33aa: write file with mode 444 (should return error) ========================================================== 02:39:34 (1713508774) [ 1837.630651] Lustre: DEBUG MARKER: 33_1 [ 1838.164590] Lustre: DEBUG MARKER: 33_2 [ 1840.485975] Lustre: DEBUG MARKER: == sanity test 33a: test open file(mode=0444) with O_RDWR (should return error) ========================================================== 02:39:37 (1713508777) [ 1842.828041] Lustre: DEBUG MARKER: == sanity test 33b: test open file with malformed flags (No panic) ========================================================== 02:39:40 (1713508780) [ 1845.118557] Lustre: DEBUG MARKER: == sanity test 33c: test write_bytes stats =============== 02:39:42 (1713508782) [ 1847.570014] Lustre: DEBUG MARKER: == sanity test 33d: openfile with 444 modes and malformed flags under remote dir ========================================================== 02:39:44 (1713508784) [ 1850.096931] Lustre: DEBUG MARKER: == sanity test 33e: mkdir and striped directory should have same mode ========================================================== 02:39:47 (1713508787) [ 1852.805257] Lustre: DEBUG MARKER: == sanity test 33f: nonroot user can create, access, and remove a striped directory ========================================================== 02:39:50 (1713508790) [ 1856.253520] Lustre: DEBUG MARKER: == sanity test 33g: nonroot user create already existing root created file ========================================================== 02:39:53 (1713508793) [ 1858.500698] Lustre: DEBUG MARKER: == sanity test 33h: temp file is located on the same MDT as target ========================================================== 02:39:55 (1713508795) [ 1871.538608] Lustre: DEBUG MARKER: == sanity test 33i: striped directory can be accessed when one MDT is down ========================================================== 02:40:08 (1713508808) [ 1883.182032] Lustre: lustre-MDT0001: Client c29815ae-77c6-4292-a9aa-c8b53e8ce2f3 (at 192.168.201.38@tcp) reconnecting [ 1883.814703] Lustre: DEBUG MARKER: == sanity test 34a: truncate file that has not been opened ===================================================================== 02:40:21 (1713508821) [ 1886.315214] Lustre: DEBUG MARKER: == sanity test 34b: O_RDONLY opening file doesn't create objects =============================================================== 02:40:23 (1713508823) [ 1888.698770] Lustre: DEBUG MARKER: == sanity test 34c: O_RDWR opening file-with-size works ======================================================================== 02:40:26 (1713508826) [ 1891.139110] Lustre: DEBUG MARKER: == sanity test 34d: write to sparse file ======================================================================================= 02:40:28 (1713508828) [ 1893.429178] Lustre: DEBUG MARKER: == sanity test 34e: create objects, some with size and some without ============================================================ 02:40:30 (1713508830) [ 1895.920952] Lustre: DEBUG MARKER: == sanity test 34f: read from a file with no objects until EOF ================================================================= 02:40:33 (1713508833) [ 1898.132242] Lustre: DEBUG MARKER: == sanity test 34g: truncate long file ========================================================================================= 02:40:35 (1713508835) [ 1900.319734] Lustre: DEBUG MARKER: == sanity test 34h: ftruncate file under grouplock should not block ========================================================== 02:40:37 (1713508837) [ 1904.877881] Lustre: DEBUG MARKER: == sanity test 35a: exec file with mode 444 (should return and not leak) ========================================================== 02:40:42 (1713508842) [ 1907.473076] Lustre: DEBUG MARKER: == sanity test 36a: MDS utime check (mknod, utime) ======= 02:40:44 (1713508844) [ 1909.794922] Lustre: DEBUG MARKER: == sanity test 36b: OST utime check (open, utime) ======== 02:40:47 (1713508847) [ 1911.605944] Lustre: DEBUG MARKER: == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 02:40:49 (1713508849) [ 1913.897316] Lustre: DEBUG MARKER: == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 02:40:51 (1713508851) [ 1915.737349] Lustre: DEBUG MARKER: == sanity test 36e: utime on non-owned file (should return error) ========================================================== 02:40:53 (1713508853) [ 1918.192620] Lustre: DEBUG MARKER: == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 02:40:55 (1713508855) [ 1921.679199] Lustre: DEBUG MARKER: == sanity test 36g: FMD cache expiry =============================================================================== 02:40:58 (1713508858) [ 1967.273580] Lustre: DEBUG MARKER: == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 02:41:44 (1713508904) [ 1970.987235] Lustre: DEBUG MARKER: == sanity test 36i: change mtime on striped directory ==== 02:41:48 (1713508908) [ 1973.610729] Lustre: DEBUG MARKER: == sanity test 38: open a regular file with O_DIRECTORY should return -ENOTDIR ============================================================= 02:41:50 (1713508910) [ 1975.959889] Lustre: DEBUG MARKER: == sanity test 39a: mtime changed on create ============== 02:41:53 (1713508913) [ 1980.414436] Lustre: DEBUG MARKER: == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 02:41:57 (1713508917) [ 1984.359145] Lustre: DEBUG MARKER: == sanity test 39c: mtime change on rename ===================================================================================== 02:42:01 (1713508921) [ 1988.896215] Lustre: DEBUG MARKER: == sanity test 39d: create, utime, stat ======================================================================================== 02:42:06 (1713508926) [ 1991.389162] Lustre: DEBUG MARKER: == sanity test 39e: create, stat, utime, stat ================================================================================== 02:42:08 (1713508928) [ 1994.069439] Lustre: DEBUG MARKER: == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 02:42:11 (1713508931) [ 1998.590739] Lustre: DEBUG MARKER: == sanity test 39g: write, chmod, stat ========================================================================================= 02:42:15 (1713508935) [ 2003.103032] Lustre: DEBUG MARKER: == sanity test 39h: write, utime within one second, stat ======================================================================= 02:42:20 (1713508940) [ 2006.688320] Lustre: DEBUG MARKER: == sanity test 39i: write, rename, stat ======================================================================================== 02:42:23 (1713508943) [ 2010.172194] Lustre: DEBUG MARKER: == sanity test 39j: write, rename, close, stat ================================================================================= 02:42:27 (1713508947) [ 2019.617299] Lustre: DEBUG MARKER: == sanity test 39k: write, utime, close, stat ================================================================================== 02:42:36 (1713508956) [ 2023.448901] Lustre: DEBUG MARKER: == sanity test 39l: directory atime update ===================================================================================== 02:42:40 (1713508960) [ 2033.403412] Lustre: DEBUG MARKER: == sanity test 39m: test atime and mtime before 1970 ===== 02:42:50 (1713508970) [ 2037.981770] Lustre: DEBUG MARKER: == sanity test 39n: check that O_NOATIME is honored ====== 02:42:55 (1713508975) [ 2051.690621] Lustre: DEBUG MARKER: == sanity test 39o: directory cached attributes updated after create ========================================================== 02:43:08 (1713508988) [ 2054.387813] Lustre: DEBUG MARKER: == sanity test 39p: remote directory cached attributes updated after create ================================================================== 02:43:11 (1713508991) [ 2057.248167] Lustre: DEBUG MARKER: == sanity test 39r: lazy atime update on OST ============= 02:43:14 (1713508994) [ 2076.941006] Lustre: DEBUG MARKER: == sanity test 39q: close won't zero out atime =========== 02:43:34 (1713509014) [ 2079.470567] Lustre: DEBUG MARKER: == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 02:43:36 (1713509016) [ 2081.977510] Lustre: DEBUG MARKER: == sanity test 41: test small file write + fstat =============================================================================== 02:43:39 (1713509019) [ 2084.495139] Lustre: DEBUG MARKER: SKIP: sanity test_42a skipping ALWAYS excluded test 42a [ 2084.855115] Lustre: DEBUG MARKER: SKIP: sanity test_42b skipping ALWAYS excluded test 42b [ 2085.243539] Lustre: DEBUG MARKER: SKIP: sanity test_42c skipping ALWAYS excluded test 42c [ 2085.677864] Lustre: DEBUG MARKER: == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 02:43:43 (1713509023) [ 2128.059713] Lustre: DEBUG MARKER: sanity test_42d: @@@@@@ FAIL: failed grant check: client:506728448 server:0