== recovery-small test 52: failover OST under load ======= 03:56:53 (1713427013) writemany pid 23952 Failing ost1 on oleg155-server Stopping /mnt/lustre-ost1 (opts:) on oleg155-server 03:57:05 (1713427025) shut down Failover ost1 to oleg155-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg155-server: oleg155-server.virtnet: executing set_default_debug -1 all pdsh@oleg155-client: oleg155-server: ssh exited with exit code 1 Started lustre-OST0000 03:57:18 (1713427038) targets are mounted 03:57:18 (1713427038) facet_failover done oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 25024 Failing ost1 on oleg155-server Stopping /mnt/lustre-ost1 (opts:) on oleg155-server 04:02:38 (1713427358) shut down Failover ost1 to oleg155-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg155-server: oleg155-server.virtnet: executing set_default_debug -1 all pdsh@oleg155-client: oleg155-server: ssh exited with exit code 1 Started lustre-OST0000 04:02:52 (1713427372) targets are mounted 04:02:52 (1713427372) facet_failover done oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 26100 Failing ost1 on oleg155-server Stopping /mnt/lustre-ost1 (opts:) on oleg155-server 04:08:09 (1713427689) shut down Failover ost1 to oleg155-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg155-server: oleg155-server.virtnet: executing set_default_debug -1 all pdsh@oleg155-client: oleg155-server: ssh exited with exit code 1 Started lustre-OST0000 04:08:22 (1713427702) targets are mounted 04:08:22 (1713427702) facet_failover done oleg155-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded Connected clients: oleg155-client.virtnet oleg155-client.virtnet