== sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 11:22:49 (1713280969) sleep 5 for ZFS zfs Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 Waiting 90s for 'none' Updated after 2s: want 'none' got 'none' fail_val=0 fail_loc=0xa03 osd-zfs.lustre-OST0000.quota_slave.force_reint=1 osd-zfs.lustre-OST0001.quota_slave.force_reint=1 Stop mds... Stopping /mnt/lustre-mds1 (opts:) on oleg108-server fail_val=0 fail_loc=0 Start mds... Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg108-server: oleg108-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg108-client: oleg108-server: ssh exited with exit code 1 Started lustre-MDT0000 affected facets: ost1 oleg108-server: oleg108-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg108-server: *.lustre-OST0000.recovery_status status: COMPLETE Waiting 200s for 'glb[1],slv[1],reint[0]' Waiting 190s for 'glb[1],slv[1],reint[0]' Waiting 180s for 'glb[1],slv[1],reint[0]' Waiting 170s for 'glb[1],slv[1],reint[0]' Waiting 160s for 'glb[1],slv[1],reint[0]' Waiting 150s for 'glb[1],slv[1],reint[0]' Waiting 140s for 'glb[1],slv[1],reint[0]' Waiting 120s for 'glb[1],slv[1],reint[0]' Waiting 110s for 'glb[1],slv[1],reint[0]' Waiting 100s for 'glb[1],slv[1],reint[0]' Waiting 90s for 'glb[1],slv[1],reint[0]' Updated after 113s: want 'glb[1],slv[1],reint[0]' got 'glb[1],slv[1],reint[0]' affected facets: ost2 oleg108-server: oleg108-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg108-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg108-server: oleg108-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg108-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg108-server: oleg108-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg108-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg108-server: oleg108-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg108-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg108-server: oleg108-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg108-server: *.lustre-OST0001.recovery_status status: INACTIVE running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota] [count=6] [oflag=sync] dd: error writing '/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota': Disk quota exceeded 5+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.317899 s, 13.2 MB/s Delete files... Wait for unlink objects finished... sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete