== replay-ost-single test 5: Fail OST during iozone ====== 10:51:45 (1713279105) iozone bg pid=17239 + iozone -i 0 -i 1 -+d -r 4 -s 1048576 -f /mnt/lustre/d0.replay-ost-single/f5.replay-ost-single tmppipe=/tmp/replay-ost-single.test_5.pipe iozone pid=17243 Iozone: Performance Test of File I/O Version $Revision: 3.483 $ Compiled for 64 bit mode. Build: linux-AMD64 Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Tue Apr 16 10:51:45 2024 >>> I/O Diagnostic mode enabled. <<< Performance measurements are invalid in this mode. Record Size 4 kB File size set to 1048576 kB Command line used: iozone -i 0 -i 1 -+d -r 4 -s 1048576 -f /mnt/lustre/d0.replay-ost-single/f5.replay-ost-single Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread Failing ost1 on oleg434-server Stopping /mnt/lustre-ost1 (opts:) on oleg434-server 10:51:54 (1713279114) shut down Failover ost1 to oleg434-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg434-server: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg434-client: oleg434-server: ssh exited with exit code 1 Started lustre-OST0000 10:52:07 (1713279127) targets are mounted 10:52:07 (1713279127) facet_failover done oleg434-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec 1048576 4 20084 34621 380390 396685 iozone test complete. iozone rc=0 sleep 5 for ZFS zfs sleep 5 for ZFS zfs