-----============= acceptance-small: sanity-scrub ============----- Tue Apr 16 10:49:54 EDT 2024 excepting tests: Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions client=34553367 MDS=34553367 OSS=34553367 Stopping clients: oleg152-client.virtnet /mnt/lustre (opts:) Stopping client oleg152-client.virtnet /mnt/lustre opts: Stopping clients: oleg152-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg152-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg152-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg152-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg152-server unloading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing unload_modules_local modules unloaded. === sanity-scrub: start setup 10:50:38 (1713279038) === Stopping clients: oleg152-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg152-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 2 oleg152-server: oleg152-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions oleg152-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg152-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/vdc pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Format mds2: /dev/vdd pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Format ost1: /dev/vde pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Format ost2: /dev/vdf pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0000 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vdd Started lustre-MDT0001 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0000 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vdf Started lustre-OST0001 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a9e8f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9e8f800.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' Updated after 6s: want 'procname_uid' got 'procname_uid' disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 10:51:39 (1713279099) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 0: Do not auto trigger OI scrub for non-backup/restore case ========================================================== 10:51:40 (1713279100) preparing... Tue Apr 16 10:51:40 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d0.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00866416 s, 121 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d0.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111698 s, 93.9 MB/s prepared Tue Apr 16 10:51:42 EDT 2024. stop mds1 stop mds2 starting MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre PASS 0 (28s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 1a: Auto trigger initial OI scrub when server mounts ========================================================== 10:52:10 (1713279130) preparing... Tue Apr 16 10:52:10 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d1a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00866422 s, 121 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d1a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904344 s, 116 MB/s prepared Tue Apr 16 10:52:12 EDT 2024. stop mds1 stop mds2 start mds1 without disabling OI scrub: -o localrecov -o user_xattr oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre fail_loc=0x193 fail_loc=0 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) stop mds1 start mds1 with disabling OI scrub: -o localrecov -o user_xattr,noscrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 PASS 1a (32s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 1b: Trigger OI scrub when MDT mounts for OI files remove/recreate case ========================================================== 10:52:44 (1713279164) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b3ba4000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b3ba4000.idle_timeout=debug disable quota as required preparing... Tue Apr 16 10:53:03 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d1b.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082135 s, 128 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d1b.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010401 s, 101 MB/s prepared Tue Apr 16 10:53:04 EDT 2024. fail_loc=0x198 fail_loc=0 stop mds1 stop mds2 removing OI files on mds1: idx= removed '/mnt/lustre-brpt/oi.16.0' removed '/mnt/lustre-brpt/oi.16.1' removed '/mnt/lustre-brpt/oi.16.10' removed '/mnt/lustre-brpt/oi.16.11' removed '/mnt/lustre-brpt/oi.16.12' removed '/mnt/lustre-brpt/oi.16.13' removed '/mnt/lustre-brpt/oi.16.14' removed '/mnt/lustre-brpt/oi.16.15' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.17' removed '/mnt/lustre-brpt/oi.16.18' removed '/mnt/lustre-brpt/oi.16.19' removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.20' removed '/mnt/lustre-brpt/oi.16.21' removed '/mnt/lustre-brpt/oi.16.22' removed '/mnt/lustre-brpt/oi.16.23' removed '/mnt/lustre-brpt/oi.16.24' removed '/mnt/lustre-brpt/oi.16.25' removed '/mnt/lustre-brpt/oi.16.26' removed '/mnt/lustre-brpt/oi.16.27' removed '/mnt/lustre-brpt/oi.16.28' removed '/mnt/lustre-brpt/oi.16.29' removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.30' removed '/mnt/lustre-brpt/oi.16.31' removed '/mnt/lustre-brpt/oi.16.32' removed '/mnt/lustre-brpt/oi.16.33' removed '/mnt/lustre-brpt/oi.16.34' removed '/mnt/lustre-brpt/oi.16.35' removed '/mnt/lustre-brpt/oi.16.36' removed '/mnt/lustre-brpt/oi.16.37' removed '/mnt/lustre-brpt/oi.16.38' removed '/mnt/lustre-brpt/oi.16.39' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.40' removed '/mnt/lustre-brpt/oi.16.41' removed '/mnt/lustre-brpt/oi.16.42' removed '/mnt/lustre-brpt/oi.16.43' removed '/mnt/lustre-brpt/oi.16.44' removed '/mnt/lustre-brpt/oi.16.45' removed '/mnt/lustre-brpt/oi.16.46' removed '/mnt/lustre-brpt/oi.16.47' removed '/mnt/lustre-brpt/oi.16.48' removed '/mnt/lustre-brpt/oi.16.49' removed '/mnt/lustre-brpt/oi.16.5' removed '/mnt/lustre-brpt/oi.16.50' removed '/mnt/lustre-brpt/oi.16.51' removed '/mnt/lustre-brpt/oi.16.52' removed '/mnt/lustre-brpt/oi.16.53' removed '/mnt/lustre-brpt/oi.16.54' removed '/mnt/lustre-brpt/oi.16.55' removed '/mnt/lustre-brpt/oi.16.56' removed '/mnt/lustre-brpt/oi.16.57' removed '/mnt/lustre-brpt/oi.16.58' removed '/mnt/lustre-brpt/oi.16.59' removed '/mnt/lustre-brpt/oi.16.6' removed '/mnt/lustre-brpt/oi.16.60' removed '/mnt/lustre-brpt/oi.16.61' removed '/mnt/lustre-brpt/oi.16.62' removed '/mnt/lustre-brpt/oi.16.63' removed '/mnt/lustre-brpt/oi.16.7' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.9' removing OI files on mds2: idx= removed '/mnt/lustre-brpt/oi.16.0' removed '/mnt/lustre-brpt/oi.16.1' removed '/mnt/lustre-brpt/oi.16.10' removed '/mnt/lustre-brpt/oi.16.11' removed '/mnt/lustre-brpt/oi.16.12' removed '/mnt/lustre-brpt/oi.16.13' removed '/mnt/lustre-brpt/oi.16.14' removed '/mnt/lustre-brpt/oi.16.15' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.17' removed '/mnt/lustre-brpt/oi.16.18' removed '/mnt/lustre-brpt/oi.16.19' removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.20' removed '/mnt/lustre-brpt/oi.16.21' removed '/mnt/lustre-brpt/oi.16.22' removed '/mnt/lustre-brpt/oi.16.23' removed '/mnt/lustre-brpt/oi.16.24' removed '/mnt/lustre-brpt/oi.16.25' removed '/mnt/lustre-brpt/oi.16.26' removed '/mnt/lustre-brpt/oi.16.27' removed '/mnt/lustre-brpt/oi.16.28' removed '/mnt/lustre-brpt/oi.16.29' removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.30' removed '/mnt/lustre-brpt/oi.16.31' removed '/mnt/lustre-brpt/oi.16.32' removed '/mnt/lustre-brpt/oi.16.33' removed '/mnt/lustre-brpt/oi.16.34' removed '/mnt/lustre-brpt/oi.16.35' removed '/mnt/lustre-brpt/oi.16.36' removed '/mnt/lustre-brpt/oi.16.37' removed '/mnt/lustre-brpt/oi.16.38' removed '/mnt/lustre-brpt/oi.16.39' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.40' removed '/mnt/lustre-brpt/oi.16.41' removed '/mnt/lustre-brpt/oi.16.42' removed '/mnt/lustre-brpt/oi.16.43' removed '/mnt/lustre-brpt/oi.16.44' removed '/mnt/lustre-brpt/oi.16.45' removed '/mnt/lustre-brpt/oi.16.46' removed '/mnt/lustre-brpt/oi.16.47' removed '/mnt/lustre-brpt/oi.16.48' removed '/mnt/lustre-brpt/oi.16.49' removed '/mnt/lustre-brpt/oi.16.5' removed '/mnt/lustre-brpt/oi.16.50' removed '/mnt/lustre-brpt/oi.16.51' removed '/mnt/lustre-brpt/oi.16.52' removed '/mnt/lustre-brpt/oi.16.53' removed '/mnt/lustre-brpt/oi.16.54' removed '/mnt/lustre-brpt/oi.16.55' removed '/mnt/lustre-brpt/oi.16.56' removed '/mnt/lustre-brpt/oi.16.57' removed '/mnt/lustre-brpt/oi.16.58' removed '/mnt/lustre-brpt/oi.16.59' removed '/mnt/lustre-brpt/oi.16.6' removed '/mnt/lustre-brpt/oi.16.60' removed '/mnt/lustre-brpt/oi.16.61' removed '/mnt/lustre-brpt/oi.16.62' removed '/mnt/lustre-brpt/oi.16.63' removed '/mnt/lustre-brpt/oi.16.7' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.9' start MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre PASS 1b (48s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 1c: Auto detect kinds of OI file(s) removed/recreated cases ========================================================== 10:53:34 (1713279214) preparing... Tue Apr 16 10:53:35 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d1c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120489 s, 87.0 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d1c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117969 s, 88.9 MB/s prepared Tue Apr 16 10:53:36 EDT 2024. stop mds1 stop mds2 removing OI files on mds1: idx=0 removed '/mnt/lustre-brpt/oi.16.0' removing OI files on mds2: idx=0 removed '/mnt/lustre-brpt/oi.16.0' start MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012b762800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012b762800.idle_timeout=debug disable quota as required preparing... Tue Apr 16 10:54:17 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d1c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118274 s, 88.7 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d1c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107751 s, 97.3 MB/s prepared Tue Apr 16 10:54:19 EDT 2024. stop mds1 stop mds2 removing OI files on mds1: idx=2 removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.32' removing OI files on mds2: idx=2 removed '/mnt/lustre-brpt/oi.16.2' removed '/mnt/lustre-brpt/oi.16.4' removed '/mnt/lustre-brpt/oi.16.8' removed '/mnt/lustre-brpt/oi.16.16' removed '/mnt/lustre-brpt/oi.16.32' start MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b60c5000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b60c5000.idle_timeout=debug disable quota as required preparing... Tue Apr 16 10:55:00 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d1c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102339 s, 102 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d1c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010656 s, 98.4 MB/s prepared Tue Apr 16 10:55:02 EDT 2024. stop mds1 stop mds2 removing OI files on mds1: idx=3 removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.9' removed '/mnt/lustre-brpt/oi.16.27' removing OI files on mds2: idx=3 removed '/mnt/lustre-brpt/oi.16.3' removed '/mnt/lustre-brpt/oi.16.9' removed '/mnt/lustre-brpt/oi.16.27' start MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 1c (111s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 2: Trigger OI scrub when MDT mounts for backup/restore case ========================================================== 10:55:27 (1713279327) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012fd7d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012fd7d800.idle_timeout=debug disable quota as required preparing... Tue Apr 16 10:55:47 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d2.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00968658 s, 108 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d2.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112515 s, 93.2 MB/s prepared Tue Apr 16 10:55:48 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre PASS 2 (63s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 4a: Auto trigger OI scrub if bad OI mapping was found (1) ========================================================== 10:56:32 (1713279392) preparing... Tue Apr 16 10:56:33 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d4a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113774 s, 92.2 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d4a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109968 s, 95.4 MB/s prepared Tue Apr 16 10:56:34 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre PASS 4a (55s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 4b: Auto trigger OI scrub if bad OI mapping was found (2) ========================================================== 10:57:28 (1713279448) preparing... Tue Apr 16 10:57:29 EDT 2024 creating 5 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d4b.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117725 s, 89.1 MB/s creating 5 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d4b.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133742 s, 78.4 MB/s prepared Tue Apr 16 10:57:30 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre OI scrub on MDS1 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 58 seconds time_since_latest_start: 7 seconds time_since_last_checkpoint: 7 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 3 updated: 0 failed: 0 prior_updated: 3 noscrub: 0 igif: 0 success_count: 6 run_time: 7 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 58 seconds time_since_latest_start: 6 seconds time_since_last_checkpoint: 6 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 1 updated: 0 failed: 0 prior_updated: 1 noscrub: 0 igif: 0 success_count: 6 run_time: 6 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 65 seconds time_since_latest_start: 14 seconds time_since_last_checkpoint: 14 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 4 updated: 0 failed: 0 prior_updated: 4 noscrub: 0 igif: 0 success_count: 6 run_time: 14 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 65 seconds time_since_latest_start: 13 seconds time_since_last_checkpoint: 13 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 2 updated: 0 failed: 0 prior_updated: 2 noscrub: 0 igif: 0 success_count: 6 run_time: 13 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 39 seconds time_since_latest_start: 39 seconds time_since_last_checkpoint: 39 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 261 updated: 50 failed: 0 prior_updated: 38 noscrub: 70 igif: 1 success_count: 7 run_time: 0 seconds average_speed: 261 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 6 seconds time_since_latest_start: 6 seconds time_since_last_checkpoint: 6 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 240 updated: 51 failed: 0 prior_updated: 36 noscrub: 73 igif: 1 success_count: 7 run_time: 0 seconds average_speed: 240 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 total 1024 -rw-r--r-- 1 root root 0 Apr 16 10:57 f1 -rw-r--r-- 1 root root 1048576 Apr 16 10:57 f2 total 1024 -rw-r--r-- 1 root root 0 Apr 16 10:57 f1 -rw-r--r-- 1 root root 1048576 Apr 16 10:57 f2 PASS 4b (131s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 10:59:41 (1713279581) preparing... Tue Apr 16 10:59:42 EDT 2024 creating 500 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d4c.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00953562 s, 110 MB/s creating 500 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d4c.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00788044 s, 133 MB/s prepared Tue Apr 16 10:59:46 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre OI scrub on MDS1 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 96 seconds time_since_latest_start: 8 seconds time_since_last_checkpoint: 8 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 3 updated: 0 failed: 0 prior_updated: 3 noscrub: 0 igif: 0 success_count: 7 run_time: 8 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 1st time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 63 seconds time_since_latest_start: 5 seconds time_since_last_checkpoint: 5 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 1 updated: 0 failed: 0 prior_updated: 1 noscrub: 0 igif: 0 success_count: 7 run_time: 6 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 103 seconds time_since_latest_start: 15 seconds time_since_last_checkpoint: 15 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 4 updated: 0 failed: 0 prior_updated: 4 noscrub: 0 igif: 0 success_count: 7 run_time: 15 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 2nd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 70 seconds time_since_latest_start: 12 seconds time_since_last_checkpoint: 12 seconds latest_start_position: 12 last_checkpoint_position: 11 first_failure_position: N/A checked: 2 updated: 0 failed: 0 prior_updated: 2 noscrub: 0 igif: 0 success_count: 7 run_time: 13 seconds average_speed: 0 objects/sec real_time_speed: 0 objects/sec current_position: 12 scrub_in_prior: no scrub_full_speed: no partial_scan: yes lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS1 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 23 seconds time_since_latest_start: 23 seconds time_since_last_checkpoint: 23 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 758 updated: 562 failed: 0 prior_updated: 21 noscrub: 70 igif: 1 success_count: 8 run_time: 0 seconds average_speed: 758 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 OI scrub on MDS2 status for the 3rd time: name: OI_scrub magic: 0x4c5fe253 oi_files: 64 status: completed flags: param: time_since_last_completed: 6 seconds time_since_latest_start: 6 seconds time_since_last_checkpoint: 6 seconds latest_start_position: 12 last_checkpoint_position: 160001 first_failure_position: N/A checked: 737 updated: 561 failed: 0 prior_updated: 21 noscrub: 73 igif: 1 success_count: 8 run_time: 0 seconds average_speed: 737 objects/sec real_time_speed: N/A current_position: N/A lf_scanned: 0 lf_repaired: 0 lf_failed: 0 -r--r--r-- 1 root root 0 Apr 16 10:59 /mnt/lustre/d4c.sanity-scrub/mds1/f4c.sanity-scrub1 -r--r--r-- 1 root root 0 Apr 16 10:59 /mnt/lustre/d4c.sanity-scrub/mds2/f4c.sanity-scrub1 PASS 4c (102s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 4d: FID in LMA mismatch with object FID won't block create ========================================================== 11:01:25 (1713279685) fail_loc=0x19b fail_loc=0 PASS 4d (6s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 4e: FID reuse can be fixed ========== 11:01:33 (1713279693) fail_loc=0x1a0 fail_loc=0 Started LFSCK on the device lustre-OST0000: scrub PASS 4e (4s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 5: OI scrub state machine =========== 11:01:39 (1713279699) oleg152-server: oleg152-server.virtnet: executing set_hostid oleg152-server: oleg152-server.virtnet: executing load_modules_local libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Tue Apr 16 11:02:59 EDT 2024 creating 100 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d5.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00880302 s, 119 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d5.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103404 s, 101 MB/s prepared Tue Apr 16 11:03:01 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled (1) oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre fail_val=3 fail_loc=0x190 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) fail_loc=0x191 stopping mds1 stopping mds2 fail_loc=0 fail_val=0 starting MDTs with OI scrub disabled (2) oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 stopping mds1 stopping mds2 fail_val=3 fail_loc=0x190 starting MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 fail_loc=0x192 Waiting 6s for 'failed' Updated after 3s: want 'failed' got 'failed' Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre fail_loc=0 fail_val=0 File: '/mnt/lustre/d5.sanity-scrub/mds2/sanity-scrub.sh' Size: 40777 Blocks: 80 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 162129603798761540 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-04-16 11:03:16.000000000 -0400 Modify: 2024-04-16 11:03:01.000000000 -0400 Change: 2024-04-16 11:03:16.000000000 -0400 Birth: - File: '/mnt/lustre/d5.sanity-scrub/mds1/sanity-scrub.sh' Size: 40777 Blocks: 80 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205289279557 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-04-16 11:03:11.000000000 -0400 Modify: 2024-04-16 11:03:00.000000000 -0400 Change: 2024-04-16 11:03:11.000000000 -0400 Birth: - PASS 5 (170s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 6: OI scrub resumes from last checkpoint ========================================================== 11:04:31 (1713279871) preparing... Tue Apr 16 11:04:33 EDT 2024 creating 100 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d6.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00821789 s, 128 MB/s creating 100 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d6.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129796 s, 80.8 MB/s prepared Tue Apr 16 11:04:34 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre fail_val=2 fail_loc=0x190 fail_loc=0x192 Waiting 6s for 'failed' Updated after 2s: want 'failed' got 'failed' fail_val=3 fail_loc=0x190 File: '/mnt/lustre/d6.sanity-scrub/mds1/sanity-scrub.sh' Size: 40777 Blocks: 80 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115305952575557 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-04-16 11:04:45.000000000 -0400 Modify: 2024-04-16 11:04:33.000000000 -0400 Change: 2024-04-16 11:04:45.000000000 -0400 Birth: - File: '/mnt/lustre/d6.sanity-scrub/mds2/sanity-scrub.sh' Size: 40777 Blocks: 80 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 162129704445280324 Links: 1 Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-04-16 11:04:50.000000000 -0400 Modify: 2024-04-16 11:04:34.000000000 -0400 Change: 2024-04-16 11:04:50.000000000 -0400 Birth: - 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) fail_loc=0x191 stopping mds1 stopping mds2 fail_val=3 fail_loc=0x190 starting MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 Waiting 6s for 'completed' Updated after 2s: want 'completed' got 'completed' PASS 6 (87s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 7: System is available during OI scrub scanning ========================================================== 11:05:59 (1713279959) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88013730a000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88013730a000.idle_timeout=debug disable quota as required preparing... Tue Apr 16 11:06:24 EDT 2024 creating 500 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d7.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0182723 s, 57.4 MB/s creating 500 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d7.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106032 s, 98.9 MB/s prepared Tue Apr 16 11:06:29 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre fail_val=3 fail_loc=0x190 File: '/mnt/lustre/d7.sanity-scrub/mds1/f7.sanity-scrub300' Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115373061439871 Links: 1 Access: (0444/-r--r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-04-16 11:06:42.000000000 -0400 Modify: 2024-04-16 11:06:26.000000000 -0400 Change: 2024-04-16 11:06:42.000000000 -0400 Birth: - File: '/mnt/lustre/d7.sanity-scrub/mds2/f7.sanity-scrub300' Size: 0 Blocks: 0 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 162129771554144638 Links: 1 Access: (0444/-r--r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-04-16 11:06:48.000000000 -0400 Modify: 2024-04-16 11:06:29.000000000 -0400 Change: 2024-04-16 11:06:48.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Waiting 6s for 'completed' Updated after 2s: want 'completed' got 'completed' PASS 7 (88s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 8: Control OI scrub manually ======== 11:07:29 (1713280049) preparing... Tue Apr 16 11:07:33 EDT 2024 creating 128 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d8.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173559 s, 60.4 MB/s creating 128 files on mds2 striped dir -i1 -c1 -H all_char /mnt/lustre/d8.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168392 s, 62.3 MB/s prepared Tue Apr 16 11:07:37 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 fail_val=1 fail_loc=0x190 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Stopped LFSCK on the device lustre-MDT0000. Stopped LFSCK on the device lustre-MDT0001. Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub fail_loc=0 fail_val=0 Waiting 6s for 'completed' PASS 8 (62s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 9: OI scrub speed control =========== 11:08:33 (1713280113) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b60c0000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b60c0000.idle_timeout=debug disable quota as required preparing... Tue Apr 16 11:08:57 EDT 2024 creating 6000 files on mds1 striped dir -i0 -c1 -H crush2 /mnt/lustre/d9.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103416 s, 101 MB/s creating 6000 files on mds2 striped dir -i1 -c1 -H fnv_1a_64 /mnt/lustre/d9.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00937733 s, 112 MB/s prepared Tue Apr 16 11:09:18 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 9 (119s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 10a: non-stopped OI scrub should auto restarts after MDS remount (1) ========================================================== 11:10:34 (1713280234) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a83e2000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a83e2000.idle_timeout=debug disable quota as required preparing... Tue Apr 16 11:11:33 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d10a.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016468 s, 63.7 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d10a.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00815816 s, 129 MB/s prepared Tue Apr 16 11:11:36 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting mds with OI scrub disabled (1) oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre fail_val=1 fail_loc=0x190 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) stopping mds1 stopping mds2 starting MDTs with OI scrub disabled (2) oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 stopping mds1 stopping mds2 starting MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 fail_loc=0 fail_val=0 Waiting 6s for 'completed' PASS 10a (149s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 11: OI scrub skips the new created objects only once ========================================================== 11:13:05 (1713280385) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800adfbd000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800adfbd000.idle_timeout=debug disable quota as required striped dir -i0 -c1 -H crush /mnt/lustre/d11.sanity-scrub/mds1 total: 100 open/close in 0.23 seconds: 432.69 ops/second striped dir -i1 -c1 -H crush /mnt/lustre/d11.sanity-scrub/mds2 total: 100 open/close in 0.23 seconds: 425.71 ops/second Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 11 (24s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 12: OI scrub can rebuild invalid /O entries ========================================================== 11:13:31 (1713280411) fail_loc=0x195 total: 78 open/close in 0.21 seconds: 365.41 ops/second 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg152-server fail_loc=0x233 Starting ost1: -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-OST0000 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub fail_loc=0 PASS 12 (195s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 13: OI scrub can rebuild missed /O entries ========================================================== 11:16:48 (1713280608) fail_loc=0x196 total: 64 open/close in 0.26 seconds: 242.00 ops/second fail_loc=0 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg152-server Starting ost1: -o localrecov -o user_xattr,noscrub /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-OST0000 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started LFSCK on the device lustre-OST0000: scrub PASS 13 (196s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 14: OI scrub can repair OST objects under lost+found ========================================================== 11:20:06 (1713280806) fail_loc=0x196 total: 1032 open/close in 2.34 seconds: 440.30 ops/second fail_loc=0 192.168.201.152@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg152-client.virtnet /mnt/lustre (opts:) Stopping /mnt/lustre-ost1 (opts:) on oleg152-server run e2fsck e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg152-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg152-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 25043 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 25044 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 280k/0k (152k/129k), time: 0.02/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 300.66MB/s [Thread 0] Scanned group range [0, 4), inodes 1469 Pass 2: Checking directory structure Pass 2: Memory used: 280k/0k (105k/176k), time: 0.01/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 164.26MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 280k/0k (105k/176k), time: 0.03/ 0.01/ 0.02 Pass 3A: Memory used: 280k/0k (105k/176k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 280k/0k (102k/179k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 6711.41MB/s Pass 4: Checking reference counts Unattached inode 103 Connect to /lost+found? yes Inode 103 ref count is 2, should be 1. Fix? yes Unattached inode 104 Connect to /lost+found? yes Inode 104 ref count is 2, should be 1. Fix? yes Unattached inode 106 Connect to /lost+found? yes Inode 106 ref count is 2, should be 1. Fix? yes Unattached inode 108 Connect to /lost+found? yes Inode 108 ref count is 2, should be 1. Fix? yes Unattached inode 111 Connect to /lost+found? yes Inode 111 ref count is 2, should be 1. Fix? yes Unattached inode 112 Connect to /lost+found? yes Inode 112 ref count is 2, should be 1. Fix? yes Unattached inode 113 Connect to /lost+found? yes Inode 113 ref count is 2, should be 1. Fix? yes Unattached inode 131 Connect to /lost+found? yes Inode 131 ref count is 2, should be 1. Fix? yes Unattached inode 147 Connect to /lost+found? yes Inode 147 ref count is 2, should be 1. Fix? yes Unattached inode 148 Connect to /lost+found? yes Inode 148 ref count is 2, should be 1. Fix? yes Unattached inode 149 Connect to /lost+found? yes Inode 149 ref count is 2, should be 1. Fix? yes Unattached inode 150 Connect to /lost+found? yes Inode 150 ref count is 2, should be 1. Fix? yes Unattached inode 151 Connect to /lost+found? yes Inode 151 ref count is 2, should be 1. Fix? yes Unattached inode 152 Connect to /lost+found? yes Inode 152 ref count is 2, should be 1. Fix? yes Unattached inode 153 Connect to /lost+found? yes Inode 153 ref count is 2, should be 1. Fix? yes Unattached inode 154 Connect to /lost+found? yes Inode 154 ref count is 2, should be 1. Fix? yes Unattached inode 183 Connect to /lost+found? yes Inode 183 ref count is 2, should be 1. Fix? yes Unattached inode 184 Connect to /lost+found? yes Inode 184 ref count is 2, should be 1. Fix? yes Unattached inode 185 Connect to /lost+found? yes Inode 185 ref count is 2, should be 1. Fix? yes Unattached inode 186 Connect to /lost+found? yes Inode 186 ref count is 2, should be 1. Fix? yes Unattached inode 187 Connect to /lost+found? yes Inode 187 ref count is 2, should be 1. Fix? yes Unattached inode 188 Connect to /lost+found? yes Inode 188 ref count is 2, should be 1. Fix? yes Unattached inode 189 Connect to /lost+found? yes Inode 189 ref count is 2, should be 1. Fix? yes Unattached inode 190 Connect to /lost+found? yes Inode 190 ref count is 2, should be 1. Fix? yes Unattached inode 191 Connect to /lost+found? yes Inode 191 ref count is 2, should be 1. Fix? yes Unattached inode 192 Connect to /lost+found? yes Inode 192 ref count is 2, should be 1. Fix? yes Unattached inode 193 Connect to /lost+found? yes Inode 193 ref count is 2, should be 1. Fix? yes Unattached inode 194 Connect to /lost+found? yes Inode 194 ref count is 2, should be 1. Fix? yes Unattached inode 195 Connect to /lost+found? yes Inode 195 ref count is 2, should be 1. Fix? yes Unattached inode 196 Connect to /lost+found? yes Inode 196 ref count is 2, should be 1. Fix? yes Unattached inode 197 Connect to /lost+found? yes Inode 197 ref count is 2, should be 1. Fix? yes Unattached inode 198 Connect to /lost+found? yes Inode 198 ref count is 2, should be 1. Fix? yes Unattached inode 221 Connect to /lost+found? yes Inode 221 ref count is 2, should be 1. Fix? yes Unattached inode 232 Connect to /lost+found? yes Inode 232 ref count is 2, should be 1. Fix? yes Unattached inode 233 Connect to /lost+found? yes Inode 233 ref count is 2, should be 1. Fix? yes Unattached inode 234 Connect to /lost+found? yes Inode 234 ref count is 2, should be 1. Fix? yes Unattached inode 235 Connect to /lost+found? yes Inode 235 ref count is 2, should be 1. Fix? yes Unattached inode 236 Connect to /lost+found? yes Inode 236 ref count is 2, should be 1. Fix? yes Unattached inode 237 Connect to /lost+found? yes Inode 237 ref count is 2, should be 1. Fix? yes Unattached inode 238 Connect to /lost+found? yes Inode 238 ref count is 2, should be 1. Fix? yes Unattached inode 239 Connect to /lost+found? yes Inode 239 ref count is 2, should be 1. Fix? yes Unattached inode 240 Connect to /lost+found? yes Inode 240 ref count is 2, should be 1. Fix? yes Unattached inode 241 Connect to /lost+found? yes Inode 241 ref count is 2, should be 1. Fix? yes Unattached inode 242 Connect to /lost+found? yes Inode 242 ref count is 2, should be 1. Fix? yes Unattached inode 243 Connect to /lost+found? yes Inode 243 ref count is 2, should be 1. Fix? yes Unattached inode 244 Connect to /lost+found? yes Inode 244 ref count is 2, should be 1. Fix? yes Unattached inode 245 Connect to /lost+found? yes Inode 245 ref count is 2, should be 1. Fix? yes Unattached inode 246 Connect to /lost+found? yes Inode 246 ref count is 2, should be 1. Fix? yes Unattached inode 247 Connect to /lost+found? yes Inode 247 ref count is 2, should be 1. Fix? yes Unattached inode 248 Connect to /lost+found? yes Inode 248 ref count is 2, should be 1. Fix? yes Unattached inode 249 Connect to /lost+found? yes Inode 249 ref count is 2, should be 1. Fix? yes Unattached inode 250 Connect to /lost+found? yes Inode 250 ref count is 2, should be 1. Fix? yes Unattached inode 251 Connect to /lost+found? yes Inode 251 ref count is 2, should be 1. Fix? yes Unattached inode 252 Connect to /lost+found? yes Inode 252 ref count is 2, should be 1. Fix? yes Unattached inode 253 Connect to /lost+found? yes Inode 253 ref count is 2, should be 1. Fix? yes Unattached inode 254 Connect to /lost+found? yes Inode 254 ref count is 2, should be 1. Fix? yes Unattached inode 255 Connect to /lost+found? yes Inode 255 ref count is 2, should be 1. Fix? yes Unattached inode 256 Connect to /lost+found? yes Inode 256 ref count is 2, should be 1. Fix? yes Unattached inode 257 Connect to /lost+found? yes Inode 257 ref count is 2, should be 1. Fix? yes Unattached inode 258 Connect to /lost+found? yes Inode 258 ref count is 2, should be 1. Fix? yes Unattached inode 259 Connect to /lost+found? yes Inode 259 ref count is 2, should be 1. Fix? yes Unattached inode 260 Connect to /lost+found? yes Inode 260 ref count is 2, should be 1. Fix? yes Unattached inode 261 Connect to /lost+found? yes Inode 261 ref count is 2, should be 1. Fix? yes Unattached inode 262 Connect to /lost+found? yes Inode 262 ref count is 2, should be 1. Fix? yes Unattached inode 263 Connect to /lost+found? yes Inode 263 ref count is 2, should be 1. Fix? yes Unattached inode 264 Connect to /lost+found? yes Inode 264 ref count is 2, should be 1. Fix? yes Unattached inode 265 Connect to /lost+found? yes Inode 265 ref count is 2, should be 1. Fix? yes Unattached inode 266 Connect to /lost+found? yes Inode 266 ref count is 2, should be 1. Fix? yes Unattached inode 267 Connect to /lost+found? yes Inode 267 ref count is 2, should be 1. Fix? yes Unattached inode 268 Connect to /lost+found? yes Inode 268 ref count is 2, should be 1. Fix? yes Unattached inode 269 Connect to /lost+found? yes Inode 269 ref count is 2, should be 1. Fix? yes Unattached inode 270 Connect to /lost+found? yes Inode 270 ref count is 2, should be 1. Fix? yes Unattached inode 271 Connect to /lost+found? yes Inode 271 ref count is 2, should be 1. Fix? yes Unattached inode 272 Connect to /lost+found? yes Inode 272 ref count is 2, should be 1. Fix? yes Unattached inode 273 Connect to /lost+found? yes Inode 273 ref count is 2, should be 1. Fix? yes Unattached inode 274 Connect to /lost+found? yes Inode 274 ref count is 2, should be 1. Fix? yes Unattached inode 275 Connect to /lost+found? yes Inode 275 ref count is 2, should be 1. Fix? yes Unattached inode 276 Connect to /lost+found? yes Inode 276 ref count is 2, should be 1. Fix? yes Unattached inode 277 Connect to /lost+found? yes Inode 277 ref count is 2, should be 1. Fix? yes Unattached inode 278 Connect to /lost+found? yes Inode 278 ref count is 2, should be 1. Fix? yes Unattached inode 279 Connect to /lost+found? yes Inode 279 ref count is 2, should be 1. Fix? yes Unattached inode 280 Connect to /lost+found? yes Inode 280 ref count is 2, should be 1. Fix? yes Unattached inode 281 Connect to /lost+found? yes Inode 281 ref count is 2, should be 1. Fix? yes Unattached inode 282 Connect to /lost+found? yes Inode 282 ref count is 2, should be 1. Fix? yes Unattached inode 283 Connect to /lost+found? yes Inode 283 ref count is 2, should be 1. Fix? yes Unattached inode 284 Connect to /lost+found? yes Inode 284 ref count is 2, should be 1. Fix? yes Unattached inode 285 Connect to /lost+found? yes Inode 285 ref count is 2, should be 1. Fix? yes Unattached inode 286 Connect to /lost+found? yes Inode 286 ref count is 2, should be 1. Fix? yes Unattached inode 287 Connect to /lost+found? yes Inode 287 ref count is 2, should be 1. Fix? yes Unattached inode 288 Connect to /lost+found? yes Inode 288 ref count is 2, should be 1. Fix? yes Unattached inode 289 Connect to /lost+found? yes Inode 289 ref count is 2, should be 1. Fix? yes Unattached inode 290 Connect to /lost+found? yes Inode 290 ref count is 2, should be 1. Fix? yes Unattached inode 291 Connect to /lost+found? yes Inode 291 ref count is 2, should be 1. Fix? yes Unattached inode 292 Connect to /lost+found? yes Inode 292 ref count is 2, should be 1. Fix? yes Unattached inode 293 Connect to /lost+found? yes Inode 293 ref count is 2, should be 1. Fix? yes Unattached inode 294 Connect to /lost+found? yes Inode 294 ref count is 2, should be 1. Fix? yes Unattached inode 295 Connect to /lost+found? yes Inode 295 ref count is 2, should be 1. Fix? yes Unattached inode 296 Connect to /lost+found? yes Inode 296 ref count is 2, should be 1. Fix? yes Unattached inode 297 Connect to /lost+found? yes Inode 297 ref count is 2, should be 1. Fix? yes Unattached inode 298 Connect to /lost+found? yes Inode 298 ref count is 2, should be 1. Fix? yes Unattached inode 299 Connect to /lost+found? yes Inode 299 ref count is 2, should be 1. Fix? yes Unattached inode 300 Connect to /lost+found? yes Inode 300 ref count is 2, should be 1. Fix? yes Unattached inode 301 Connect to /lost+found? yes Inode 301 ref count is 2, should be 1. Fix? yes Unattached inode 302 Connect to /lost+found? yes Inode 302 ref count is 2, should be 1. Fix? yes Unattached inode 303 Connect to /lost+found? yes Inode 303 ref count is 2, should be 1. Fix? yes Unattached inode 304 Connect to /lost+found? yes Inode 304 ref count is 2, should be 1. Fix? yes Unattached inode 305 Connect to /lost+found? yes Inode 305 ref count is 2, should be 1. Fix? yes Unattached inode 306 Connect to /lost+found? yes Inode 306 ref count is 2, should be 1. Fix? yes Unattached inode 307 Connect to /lost+found? yes Inode 307 ref count is 2, should be 1. Fix? yes Unattached inode 308 Connect to /lost+found? yes Inode 308 ref count is 2, should be 1. Fix? yes Unattached inode 309 Connect to /lost+found? yes Inode 309 ref count is 2, should be 1. Fix? yes Unattached inode 310 Connect to /lost+found? yes Inode 310 ref count is 2, should be 1. Fix? yes Unattached inode 311 Connect to /lost+found? yes Inode 311 ref count is 2, should be 1. Fix? yes Unattached inode 312 Connect to /lost+found? yes Inode 312 ref count is 2, should be 1. Fix? yes Unattached inode 313 Connect to /lost+found? yes Inode 313 ref count is 2, should be 1. Fix? yes Unattached inode 314 Connect to /lost+found? yes Inode 314 ref count is 2, should be 1. Fix? yes Unattached inode 315 Connect to /lost+found? yes Inode 315 ref count is 2, should be 1. Fix? yes Unattached inode 316 Connect to /lost+found? yes Inode 316 ref count is 2, should be 1. Fix? yes Unattached inode 317 Connect to /lost+found? yes Inode 317 ref count is 2, should be 1. Fix? yes Unattached inode 318 Connect to /lost+found? yes Inode 318 ref count is 2, should be 1. Fix? yes Unattached inode 319 Connect to /lost+found? yes Inode 319 ref count is 2, should be 1. Fix? yes Unattached inode 320 Connect to /lost+found? yes Inode 320 ref count is 2, should be 1. Fix? yes Unattached inode 321 Connect to /lost+found? yes Inode 321 ref count is 2, should be 1. Fix? yes Unattached inode 322 Connect to /lost+found? yes Inode 322 ref count is 2, should be 1. Fix? yes Unattached inode 323 Connect to /lost+found? yes Inode 323 ref count is 2, should be 1. Fix? yes Unattached inode 324 Connect to /lost+found? yes Inode 324 ref count is 2, should be 1. Fix? yes Unattached inode 325 Connect to /lost+found? yes Inode 325 ref count is 2, should be 1. Fix? yes Unattached inode 326 Connect to /lost+found? yes Inode 326 ref count is 2, should be 1. Fix? yes Unattached inode 327 Connect to /lost+found? yes Inode 327 ref count is 2, should be 1. Fix? yes Unattached inode 328 Connect to /lost+found? yes Inode 328 ref count is 2, should be 1. Fix? yes Unattached inode 375 Connect to /lost+found? yes Inode 375 ref count is 2, should be 1. Fix? yes Unattached inode 376 Connect to /lost+found? yes Inode 376 ref count is 2, should be 1. Fix? yes Unattached inode 377 Connect to /lost+found? yes Inode 377 ref count is 2, should be 1. Fix? yes Unattached inode 378 Connect to /lost+found? yes Inode 378 ref count is 2, should be 1. Fix? yes Unattached inode 379 Connect to /lost+found? yes Inode 379 ref count is 2, should be 1. Fix? yes Unattached inode 380 Connect to /lost+found? yes Inode 380 ref count is 2, should be 1. Fix? yes Unattached inode 381 Connect to /lost+found? yes Inode 381 ref count is 2, should be 1. Fix? yes Unattached inode 382 Connect to /lost+found? yes Inode 382 ref count is 2, should be 1. Fix? yes Unattached inode 383 Connect to /lost+found? yes Inode 383 ref count is 2, should be 1. Fix? yes Unattached inode 384 Connect to /lost+found? yes Inode 384 ref count is 2, should be 1. Fix? yes Unattached inode 385 Connect to /lost+found? yes Inode 385 ref count is 2, should be 1. Fix? yes Unattached inode 386 Connect to /lost+found? yes Inode 386 ref count is 2, should be 1. Fix? yes Unattached inode 387 Connect to /lost+found? yes Inode 387 ref count is 2, should be 1. Fix? yes Unattached inode 388 Connect to /lost+found? yes Inode 388 ref count is 2, should be 1. Fix? yes Unattached inode 389 Connect to /lost+found? yes Inode 389 ref count is 2, should be 1. Fix? yes Unattached inode 390 Connect to /lost+found? yes Inode 390 ref count is 2, should be 1. Fix? yes Unattached inode 391 Connect to /lost+found? yes Inode 391 ref count is 2, should be 1. Fix? yes Unattached inode 392 Connect to /lost+found? yes Inode 392 ref count is 2, should be 1. Fix? yes Unattached inode 393 Connect to /lost+found? yes Inode 393 ref count is 2, should be 1. Fix? yes Unattached inode 394 Connect to /lost+found? yes Inode 394 ref count is 2, should be 1. Fix? yes Unattached inode 395 Connect to /lost+found? yes Inode 395 ref count is 2, should be 1. Fix? yes Unattached inode 396 Connect to /lost+found? yes Inode 396 ref count is 2, should be 1. Fix? yes Unattached inode 397 Connect to /lost+found? yes Inode 397 ref count is 2, should be 1. Fix? yes Unattached inode 398 Connect to /lost+found? yes Inode 398 ref count is 2, should be 1. Fix? yes Unattached inode 399 Connect to /lost+found? yes Inode 399 ref count is 2, should be 1. Fix? yes Unattached inode 400 Connect to /lost+found? yes Inode 400 ref count is 2, should be 1. Fix? yes Unattached inode 401 Connect to /lost+found? yes Inode 401 ref count is 2, should be 1. Fix? yes Unattached inode 402 Connect to /lost+found? yes Inode 402 ref count is 2, should be 1. Fix? yes Unattached inode 403 Connect to /lost+found? yes Inode 403 ref count is 2, should be 1. Fix? yes Unattached inode 404 Connect to /lost+found? yes Inode 404 ref count is 2, should be 1. Fix? yes Unattached inode 405 Connect to /lost+found? yes Inode 405 ref count is 2, should be 1. Fix? yes Unattached inode 406 Connect to /lost+found? yes Inode 406 ref count is 2, should be 1. Fix? yes Unattached inode 407 Connect to /lost+found? yes Inode 407 ref count is 2, should be 1. Fix? yes Unattached inode 408 Connect to /lost+found? yes Inode 408 ref count is 2, should be 1. Fix? yes Unattached inode 409 Connect to /lost+found? yes Inode 409 ref count is 2, should be 1. Fix? yes Unattached inode 410 Connect to /lost+found? yes Inode 410 ref count is 2, should be 1. Fix? yes Unattached inode 411 Connect to /lost+found? yes Inode 411 ref count is 2, should be 1. Fix? yes Unattached inode 412 Connect to /lost+found? yes Inode 412 ref count is 2, should be 1. Fix? yes Unattached inode 413 Connect to /lost+found? yes Inode 413 ref count is 2, should be 1. Fix? yes Unattached inode 414 Connect to /lost+found? yes Inode 414 ref count is 2, should be 1. Fix? yes Unattached inode 415 Connect to /lost+found? yes Inode 415 ref count is 2, should be 1. Fix? yes Unattached inode 416 Connect to /lost+found? yes Inode 416 ref count is 2, should be 1. Fix? yes Unattached inode 417 Connect to /lost+found? yes Inode 417 ref count is 2, should be 1. Fix? yes Unattached inode 418 Connect to /lost+found? yes Inode 418 ref count is 2, should be 1. Fix? yes Unattached inode 419 Connect to /lost+found? yes Inode 419 ref count is 2, should be 1. Fix? yes Unattached inode 420 Connect to /lost+found? yes Inode 420 ref count is 2, should be 1. Fix? yes Unattached inode 421 Connect to /lost+found? yes Inode 421 ref count is 2, should be 1. Fix? yes Unattached inode 422 Connect to /lost+found? yes Inode 422 ref count is 2, should be 1. Fix? yes Unattached inode 423 Connect to /lost+found? yes Inode 423 ref count is 2, should be 1. Fix? yes Unattached inode 424 Connect to /lost+found? yes Inode 424 ref count is 2, should be 1. Fix? yes Unattached inode 425 Connect to /lost+found? yes Inode 425 ref count is 2, should be 1. Fix? yes Unattached inode 426 Connect to /lost+found? yes Inode 426 ref count is 2, should be 1. Fix? yes Unattached inode 427 Connect to /lost+found? yes Inode 427 ref count is 2, should be 1. Fix? yes Unattached inode 428 Connect to /lost+found? yes Inode 428 ref count is 2, should be 1. Fix? yes Unattached inode 429 Connect to /lost+found? yes Inode 429 ref count is 2, should be 1. Fix? yes Unattached inode 430 Connect to /lost+found? yes Inode 430 ref count is 2, should be 1. Fix? yes Unattached inode 431 Connect to /lost+found? yes Inode 431 ref count is 2, should be 1. Fix? yes Unattached inode 432 Connect to /lost+found? yes Inode 432 ref count is 2, should be 1. Fix? yes Unattached inode 433 Connect to /lost+found? yes Inode 433 ref count is 2, should be 1. Fix? yes Unattached inode 434 Connect to /lost+found? yes Inode 434 ref count is 2, should be 1. Fix? yes Unattached inode 435 Connect to /lost+found? yes Inode 435 ref count is 2, should be 1. Fix? yes Unattached inode 436 Connect to /lost+found? yes Inode 436 ref count is 2, should be 1. Fix? yes Unattached inode 437 Connect to /lost+found? yes Inode 437 ref count is 2, should be 1. Fix? yes Unattached inode 438 Connect to /lost+found? yes Inode 438 ref count is 2, should be 1. Fix? yes Unattached inode 439 Connect to /lost+found? yes Inode 439 ref count is 2, should be 1. Fix? yes Unattached inode 440 Connect to /lost+found? yes Inode 440 ref count is 2, should be 1. Fix? yes Unattached inode 441 Connect to /lost+found? yes Inode 441 ref count is 2, should be 1. Fix? yes Unattached inode 442 Connect to /lost+found? yes Inode 442 ref count is 2, should be 1. Fix? yes Unattached inode 443 Connect to /lost+found? yes Inode 443 ref count is 2, should be 1. Fix? yes Unattached inode 444 Connect to /lost+found? yes Inode 444 ref count is 2, should be 1. Fix? yes Unattached inode 445 Connect to /lost+found? yes Inode 445 ref count is 2, should be 1. Fix? yes Unattached inode 446 Connect to /lost+found? yes Inode 446 ref count is 2, should be 1. Fix? yes Unattached inode 447 Connect to /lost+found? yes Inode 447 ref count is 2, should be 1. Fix? yes Unattached inode 448 Connect to /lost+found? yes Inode 448 ref count is 2, should be 1. Fix? yes Unattached inode 449 Connect to /lost+found? yes Inode 449 ref count is 2, should be 1. Fix? yes Unattached inode 450 Connect to /lost+found? yes Inode 450 ref count is 2, should be 1. Fix? yes Unattached inode 451 Connect to /lost+found? yes Inode 451 ref count is 2, should be 1. Fix? yes Unattached inode 452 Connect to /lost+found? yes Inode 452 ref count is 2, should be 1. Fix? yes Unattached inode 453 Connect to /lost+found? yes Inode 453 ref count is 2, should be 1. Fix? yes Unattached inode 454 Connect to /lost+found? yes Inode 454 ref count is 2, should be 1. Fix? yes Unattached inode 455 Connect to /lost+found? yes Inode 455 ref count is 2, should be 1. Fix? yes Unattached inode 456 Connect to /lost+found? yes Inode 456 ref count is 2, should be 1. Fix? yes Unattached inode 457 Connect to /lost+found? yes Inode 457 ref count is 2, should be 1. Fix? yes Unattached inode 458 Connect to /lost+found? yes Inode 458 ref count is 2, should be 1. Fix? yes Unattached inode 459 Connect to /lost+found? yes Inode 459 ref count is 2, should be 1. Fix? yes Unattached inode 460 Connect to /lost+found? yes Inode 460 ref count is 2, should be 1. Fix? yes Unattached inode 461 Connect to /lost+found? yes Inode 461 ref count is 2, should be 1. Fix? yes Unattached inode 462 Connect to /lost+found? yes Inode 462 ref count is 2, should be 1. Fix? yes Unattached inode 463 Connect to /lost+found? yes Inode 463 ref count is 2, should be 1. Fix? yes Unattached inode 464 Connect to /lost+found? yes Inode 464 ref count is 2, should be 1. Fix? yes Unattached inode 465 Connect to /lost+found? yes Inode 465 ref count is 2, should be 1. Fix? yes Unattached inode 466 Connect to /lost+found? yes Inode 466 ref count is 2, should be 1. Fix? yes Unattached inode 467 Connect to /lost+found? yes Inode 467 ref count is 2, should be 1. Fix? yes Unattached inode 468 Connect to /lost+found? yes Inode 468 ref count is 2, should be 1. Fix? yes Unattached inode 469 Connect to /lost+found? yes Inode 469 ref count is 2, should be 1. Fix? yes Unattached inode 470 Connect to /lost+found? yes Inode 470 ref count is 2, should be 1. Fix? yes Unattached inode 471 Connect to /lost+found? yes Inode 471 ref count is 2, should be 1. Fix? yes Unattached inode 472 Connect to /lost+found? yes Inode 472 ref count is 2, should be 1. Fix? yes Unattached inode 473 Connect to /lost+found? yes Inode 473 ref count is 2, should be 1. Fix? yes Unattached inode 474 Connect to /lost+found? yes Inode 474 ref count is 2, should be 1. Fix? yes Unattached inode 475 Connect to /lost+found? yes Inode 475 ref count is 2, should be 1. Fix? yes Unattached inode 476 Connect to /lost+found? yes Inode 476 ref count is 2, should be 1. Fix? yes Unattached inode 477 Connect to /lost+found? yes Inode 477 ref count is 2, should be 1. Fix? yes Unattached inode 478 Connect to /lost+found? yes Inode 478 ref count is 2, should be 1. Fix? yes Unattached inode 479 Connect to /lost+found? yes Inode 479 ref count is 2, should be 1. Fix? yes Unattached inode 480 Connect to /lost+found? yes Inode 480 ref count is 2, should be 1. Fix? yes Unattached inode 481 Connect to /lost+found? yes Inode 481 ref count is 2, should be 1. Fix? yes Unattached inode 482 Connect to /lost+found? yes Inode 482 ref count is 2, should be 1. Fix? yes Unattached inode 483 Connect to /lost+found? yes Inode 483 ref count is 2, should be 1. Fix? yes Unattached inode 484 Connect to /lost+found? yes Inode 484 ref count is 2, should be 1. Fix? yes Unattached inode 485 Connect to /lost+found? yes Inode 485 ref count is 2, should be 1. Fix? yes Unattached inode 486 Connect to /lost+found? yes Inode 486 ref count is 2, should be 1. Fix? yes Unattached inode 487 Connect to /lost+found? yes Inode 487 ref count is 2, should be 1. Fix? yes Unattached inode 488 Connect to /lost+found? yes Inode 488 ref count is 2, should be 1. Fix? yes Unattached inode 489 Connect to /lost+found? yes Inode 489 ref count is 2, should be 1. Fix? yes Unattached inode 490 Connect to /lost+found? yes Inode 490 ref count is 2, should be 1. Fix? yes Unattached inode 491 Connect to /lost+found? yes Inode 491 ref count is 2, should be 1. Fix? yes Unattached inode 492 Connect to /lost+found? yes Inode 492 ref count is 2, should be 1. Fix? yes Unattached inode 493 Connect to /lost+found? yes Inode 493 ref count is 2, should be 1. Fix? yes Unattached inode 494 Connect to /lost+found? yes Inode 494 ref count is 2, should be 1. Fix? yes Unattached inode 495 Connect to /lost+found? yes Inode 495 ref count is 2, should be 1. Fix? yes Unattached inode 496 Connect to /lost+found? yes Inode 496 ref count is 2, should be 1. Fix? yes Unattached inode 497 Connect to /lost+found? yes Inode 497 ref count is 2, should be 1. Fix? yes Unattached inode 498 Connect to /lost+found? yes Inode 498 ref count is 2, should be 1. Fix? yes Unattached inode 499 Connect to /lost+found? yes Inode 499 ref count is 2, should be 1. Fix? yes Unattached inode 500 Connect to /lost+found? yes Inode 500 ref count is 2, should be 1. Fix? yes Unattached inode 501 Connect to /lost+found? yes Inode 501 ref count is 2, should be 1. Fix? yes Unattached inode 502 Connect to /lost+found? yes Inode 502 ref count is 2, should be 1. Fix? yes Unattached inode 503 Connect to /lost+found? yes Inode 503 ref count is 2, should be 1. Fix? yes Unattached inode 504 Connect to /lost+found? yes Inode 504 ref count is 2, should be 1. Fix? yes Unattached inode 505 Connect to /lost+found? yes Inode 505 ref count is 2, should be 1. Fix? yes Unattached inode 506 Connect to /lost+found? yes Inode 506 ref count is 2, should be 1. Fix? yes Unattached inode 507 Connect to /lost+found? yes Inode 507 ref count is 2, should be 1. Fix? yes Unattached inode 508 Connect to /lost+found? yes Inode 508 ref count is 2, should be 1. Fix? yes Unattached inode 509 Connect to /lost+found? yes Inode 509 ref count is 2, should be 1. Fix? yes Unattached inode 510 Connect to /lost+found? yes Inode 510 ref count is 2, should be 1. Fix? yes Unattached inode 511 Connect to /lost+found? yes Inode 511 ref count is 2, should be 1. Fix? yes Unattached inode 512 Connect to /lost+found? yes Inode 512 ref count is 2, should be 1. Fix? yes Unattached inode 513 Connect to /lost+found? yes Inode 513 ref count is 2, should be 1. Fix? yes Unattached inode 514 Connect to /lost+found? yes Inode 514 ref count is 2, should be 1. Fix? yes Unattached inode 515 Connect to /lost+found? yes Inode 515 ref count is 2, should be 1. Fix? yes Unattached inode 516 Connect to /lost+found? yes Inode 516 ref count is 2, should be 1. Fix? yes Unattached inode 517 Connect to /lost+found? yes Inode 517 ref count is 2, should be 1. Fix? yes Unattached inode 518 Connect to /lost+found? yes Inode 518 ref count is 2, should be 1. Fix? yes Unattached inode 519 Connect to /lost+found? yes Inode 519 ref count is 2, should be 1. Fix? yes Unattached inode 520 Connect to /lost+found? yes Inode 520 ref count is 2, should be 1. Fix? yes Unattached inode 521 Connect to /lost+found? yes Inode 521 ref count is 2, should be 1. Fix? yes Unattached inode 522 Connect to /lost+found? yes Inode 522 ref count is 2, should be 1. Fix? yes Unattached inode 523 Connect to /lost+found? yes Inode 523 ref count is 2, should be 1. Fix? yes Unattached inode 524 Connect to /lost+found? yes Inode 524 ref count is 2, should be 1. Fix? yes Unattached inode 525 Connect to /lost+found? yes Inode 525 ref count is 2, should be 1. Fix? yes Unattached inode 526 Connect to /lost+found? yes Inode 526 ref count is 2, should be 1. Fix? yes Unattached inode 527 Connect to /lost+found? yes Inode 527 ref count is 2, should be 1. Fix? yes Unattached inode 528 Connect to /lost+found? yes Inode 528 ref count is 2, should be 1. Fix? yes Unattached inode 529 Connect to /lost+found? yes Inode 529 ref count is 2, should be 1. Fix? yes Unattached inode 530 Connect to /lost+found? yes Inode 530 ref count is 2, should be 1. Fix? yes Unattached inode 531 Connect to /lost+found? yes Inode 531 ref count is 2, should be 1. Fix? yes Unattached inode 532 Connect to /lost+found? yes Inode 532 ref count is 2, should be 1. Fix? yes Unattached inode 533 Connect to /lost+found? yes Inode 533 ref count is 2, should be 1. Fix? yes Unattached inode 534 Connect to /lost+found? yes Inode 534 ref count is 2, should be 1. Fix? yes Unattached inode 535 Connect to /lost+found? yes Inode 535 ref count is 2, should be 1. Fix? yes Unattached inode 536 Connect to /lost+found? yes Inode 536 ref count is 2, should be 1. Fix? yes Unattached inode 537 Connect to /lost+found? yes Inode 537 ref count is 2, should be 1. Fix? yes Unattached inode 538 Connect to /lost+found? yes Inode 538 ref count is 2, should be 1. Fix? yes Unattached inode 539 Connect to /lost+found? yes Inode 539 ref count is 2, should be 1. Fix? yes Unattached inode 540 Connect to /lost+found? yes Inode 540 ref count is 2, should be 1. Fix? yes Unattached inode 541 Connect to /lost+found? yes Inode 541 ref count is 2, should be 1. Fix? yes Unattached inode 542 Connect to /lost+found? yes Inode 542 ref count is 2, should be 1. Fix? yes Unattached inode 543 Connect to /lost+found? yes Inode 543 ref count is 2, should be 1. Fix? yes Unattached inode 544 Connect to /lost+found? yes Inode 544 ref count is 2, should be 1. Fix? yes Unattached inode 545 Connect to /lost+found? yes Inode 545 ref count is 2, should be 1. Fix? yes Unattached inode 546 Connect to /lost+found? yes Inode 546 ref count is 2, should be 1. Fix? yes Unattached inode 547 Connect to /lost+found? yes Inode 547 ref count is 2, should be 1. Fix? yes Unattached inode 548 Connect to /lost+found? yes Inode 548 ref count is 2, should be 1. Fix? yes Unattached inode 549 Connect to /lost+found? yes Inode 549 ref count is 2, should be 1. Fix? yes Unattached inode 550 Connect to /lost+found? yes Inode 550 ref count is 2, should be 1. Fix? yes Unattached inode 551 Connect to /lost+found? yes Inode 551 ref count is 2, should be 1. Fix? yes Unattached inode 552 Connect to /lost+found? yes Inode 552 ref count is 2, should be 1. Fix? yes Unattached inode 553 Connect to /lost+found? yes Inode 553 ref count is 2, should be 1. Fix? yes Unattached inode 554 Connect to /lost+found? yes Inode 554 ref count is 2, should be 1. Fix? yes Unattached inode 555 Connect to /lost+found? yes Inode 555 ref count is 2, should be 1. Fix? yes Unattached inode 556 Connect to /lost+found? yes Inode 556 ref count is 2, should be 1. Fix? yes Unattached inode 557 Connect to /lost+found? yes Inode 557 ref count is 2, should be 1. Fix? yes Unattached inode 558 Connect to /lost+found? yes Inode 558 ref count is 2, should be 1. Fix? yes Unattached inode 559 Connect to /lost+found? yes Inode 559 ref count is 2, should be 1. Fix? yes Unattached inode 560 Connect to /lost+found? yes Inode 560 ref count is 2, should be 1. Fix? yes Unattached inode 561 Connect to /lost+found? yes Inode 561 ref count is 2, should be 1. Fix? yes Unattached inode 562 Connect to /lost+found? yes Inode 562 ref count is 2, should be 1. Fix? yes Unattached inode 563 Connect to /lost+found? yes Inode 563 ref count is 2, should be 1. Fix? yes Unattached inode 564 Connect to /lost+found? yes Inode 564 ref count is 2, should be 1. Fix? yes Unattached inode 565 Connect to /lost+found? yes Inode 565 ref count is 2, should be 1. Fix? yes Unattached inode 566 Connect to /lost+found? yes Inode 566 ref count is 2, should be 1. Fix? yes Unattached inode 567 Connect to /lost+found? yes Inode 567 ref count is 2, should be 1. Fix? yes Unattached inode 568 Connect to /lost+found? yes Inode 568 ref count is 2, should be 1. Fix? yes Unattached inode 569 Connect to /lost+found? yes Inode 569 ref count is 2, should be 1. Fix? yes Unattached inode 570 Connect to /lost+found? yes Inode 570 ref count is 2, should be 1. Fix? yes Unattached inode 571 Connect to /lost+found? yes Inode 571 ref count is 2, should be 1. Fix? yes Unattached inode 572 Connect to /lost+found? yes Inode 572 ref count is 2, should be 1. Fix? yes Unattached inode 573 Connect to /lost+found? yes Inode 573 ref count is 2, should be 1. Fix? yes Unattached inode 574 Connect to /lost+found? yes Inode 574 ref count is 2, should be 1. Fix? yes Unattached inode 575 Connect to /lost+found? yes Inode 575 ref count is 2, should be 1. Fix? yes Unattached inode 576 Connect to /lost+found? yes Inode 576 ref count is 2, should be 1. Fix? yes Unattached inode 577 Connect to /lost+found? yes Inode 577 ref count is 2, should be 1. Fix? yes Unattached inode 578 Connect to /lost+found? yes Inode 578 ref count is 2, should be 1. Fix? yes Unattached inode 579 Connect to /lost+found? yes Inode 579 ref count is 2, should be 1. Fix? yes Unattached inode 580 Connect to /lost+found? yes Inode 580 ref count is 2, should be 1. Fix? yes Unattached inode 581 Connect to /lost+found? yes Inode 581 ref count is 2, should be 1. Fix? yes Unattached inode 582 Connect to /lost+found? yes Inode 582 ref count is 2, should be 1. Fix? yes Unattached inode 583 Connect to /lost+found? yes Inode 583 ref count is 2, should be 1. Fix? yes Unattached inode 584 Connect to /lost+found? yes Inode 584 ref count is 2, should be 1. Fix? yes Unattached inode 585 Connect to /lost+found? yes Inode 585 ref count is 2, should be 1. Fix? yes Unattached inode 586 Connect to /lost+found? yes Inode 586 ref count is 2, should be 1. Fix? yes Unattached inode 587 Connect to /lost+found? yes Inode 587 ref count is 2, should be 1. Fix? yes Unattached inode 588 Connect to /lost+found? yes Inode 588 ref count is 2, should be 1. Fix? yes Unattached inode 589 Connect to /lost+found? yes Inode 589 ref count is 2, should be 1. Fix? yes Unattached inode 590 Connect to /lost+found? yes Inode 590 ref count is 2, should be 1. Fix? yes Unattached inode 591 Connect to /lost+found? yes Inode 591 ref count is 2, should be 1. Fix? yes Unattached inode 592 Connect to /lost+found? yes Inode 592 ref count is 2, should be 1. Fix? yes Unattached inode 593 Connect to /lost+found? yes Inode 593 ref count is 2, should be 1. Fix? yes Unattached inode 594 Connect to /lost+found? yes Inode 594 ref count is 2, should be 1. Fix? yes Unattached inode 595 Connect to /lost+found? yes Inode 595 ref count is 2, should be 1. Fix? yes Unattached inode 596 Connect to /lost+found? yes Inode 596 ref count is 2, should be 1. Fix? yes Unattached inode 597 Connect to /lost+found? yes Inode 597 ref count is 2, should be 1. Fix? yes Unattached inode 598 Connect to /lost+found? yes Inode 598 ref count is 2, should be 1. Fix? yes Unattached inode 599 Connect to /lost+found? yes Inode 599 ref count is 2, should be 1. Fix? yes Unattached inode 600 Connect to /lost+found? yes Inode 600 ref count is 2, should be 1. Fix? yes Unattached inode 601 Connect to /lost+found? yes Inode 601 ref count is 2, should be 1. Fix? yes Unattached inode 602 Connect to /lost+found? yes Inode 602 ref count is 2, should be 1. Fix? yes Unattached inode 603 Connect to /lost+found? yes Inode 603 ref count is 2, should be 1. Fix? yes Unattached inode 604 Connect to /lost+found? yes Inode 604 ref count is 2, should be 1. Fix? yes Unattached inode 605 Connect to /lost+found? yes Inode 605 ref count is 2, should be 1. Fix? yes Unattached inode 606 Connect to /lost+found? yes Inode 606 ref count is 2, should be 1. Fix? yes Unattached inode 607 Connect to /lost+found? yes Inode 607 ref count is 2, should be 1. Fix? yes Unattached inode 608 Connect to /lost+found? yes Inode 608 ref count is 2, should be 1. Fix? yes Unattached inode 609 Connect to /lost+found? yes Inode 609 ref count is 2, should be 1. Fix? yes Unattached inode 610 Connect to /lost+found? yes Inode 610 ref count is 2, should be 1. Fix? yes Unattached inode 611 Connect to /lost+found? yes Inode 611 ref count is 2, should be 1. Fix? yes Unattached inode 612 Connect to /lost+found? yes Inode 612 ref count is 2, should be 1. Fix? yes Unattached inode 613 Connect to /lost+found? yes Inode 613 ref count is 2, should be 1. Fix? yes Unattached inode 614 Connect to /lost+found? yes Inode 614 ref count is 2, should be 1. Fix? yes Unattached inode 615 Connect to /lost+found? yes Inode 615 ref count is 2, should be 1. Fix? yes Unattached inode 616 Connect to /lost+found? yes Inode 616 ref count is 2, should be 1. Fix? yes Unattached inode 617 Connect to /lost+found? yes Inode 617 ref count is 2, should be 1. Fix? yes Unattached inode 618 Connect to /lost+found? yes Inode 618 ref count is 2, should be 1. Fix? yes Unattached inode 619 Connect to /lost+found? yes Inode 619 ref count is 2, should be 1. Fix? yes Unattached inode 620 Connect to /lost+found? yes Inode 620 ref count is 2, should be 1. Fix? yes Unattached inode 621 Connect to /lost+found? yes Inode 621 ref count is 2, should be 1. Fix? yes Unattached inode 622 Connect to /lost+found? yes Inode 622 ref count is 2, should be 1. Fix? yes Unattached inode 623 Connect to /lost+found? yes Inode 623 ref count is 2, should be 1. Fix? yes Unattached inode 624 Connect to /lost+found? yes Inode 624 ref count is 2, should be 1. Fix? yes Unattached inode 625 Connect to /lost+found? yes Inode 625 ref count is 2, should be 1. Fix? yes Unattached inode 626 Connect to /lost+found? yes Inode 626 ref count is 2, should be 1. Fix? yes Unattached inode 627 Connect to /lost+found? yes Inode 627 ref count is 2, should be 1. Fix? yes Unattached inode 628 Connect to /lost+found? yes Inode 628 ref count is 2, should be 1. Fix? yes Unattached inode 629 Connect to /lost+found? yes Inode 629 ref count is 2, should be 1. Fix? yes Unattached inode 630 Connect to /lost+found? yes Inode 630 ref count is 2, should be 1. Fix? yes Unattached inode 631 Connect to /lost+found? yes Inode 631 ref count is 2, should be 1. Fix? yes Unattached inode 632 Connect to /lost+found? yes Inode 632 ref count is 2, should be 1. Fix? yes Unattached inode 633 Connect to /lost+found? yes Inode 633 ref count is 2, should be 1. Fix? yes Unattached inode 634 Connect to /lost+found? yes Inode 634 ref count is 2, should be 1. Fix? yes Unattached inode 635 Connect to /lost+found? yes Inode 635 ref count is 2, should be 1. Fix? yes Unattached inode 636 Connect to /lost+found? yes Inode 636 ref count is 2, should be 1. Fix? yes Unattached inode 637 Connect to /lost+found? yes Inode 637 ref count is 2, should be 1. Fix? yes Unattached inode 638 Connect to /lost+found? yes Inode 638 ref count is 2, should be 1. Fix? yes Unattached inode 639 Connect to /lost+found? yes Inode 639 ref count is 2, should be 1. Fix? yes Unattached inode 640 Connect to /lost+found? yes Inode 640 ref count is 2, should be 1. Fix? yes Unattached inode 641 Connect to /lost+found? yes Inode 641 ref count is 2, should be 1. Fix? yes Unattached inode 642 Connect to /lost+found? yes Inode 642 ref count is 2, should be 1. Fix? yes Unattached inode 643 Connect to /lost+found? yes Inode 643 ref count is 2, should be 1. Fix? yes Unattached inode 644 Connect to /lost+found? yes Inode 644 ref count is 2, should be 1. Fix? yes Unattached inode 645 Connect to /lost+found? yes Inode 645 ref count is 2, should be 1. Fix? yes Unattached inode 646 Connect to /lost+found? yes Inode 646 ref count is 2, should be 1. Fix? yes Unattached inode 647 Connect to /lost+found? yes Inode 647 ref count is 2, should be 1. Fix? yes Unattached inode 648 Connect to /lost+found? yes Inode 648 ref count is 2, should be 1. Fix? yes Unattached inode 649 Connect to /lost+found? yes Inode 649 ref count is 2, should be 1. Fix? yes Unattached inode 650 Connect to /lost+found? yes Inode 650 ref count is 2, should be 1. Fix? yes Unattached inode 651 Connect to /lost+found? yes Inode 651 ref count is 2, should be 1. Fix? yes Unattached inode 652 Connect to /lost+found? yes Inode 652 ref count is 2, should be 1. Fix? yes Unattached inode 653 Connect to /lost+found? yes Inode 653 ref count is 2, should be 1. Fix? yes Unattached inode 654 Connect to /lost+found? yes Inode 654 ref count is 2, should be 1. Fix? yes Unattached inode 655 Connect to /lost+found? yes Inode 655 ref count is 2, should be 1. Fix? yes Unattached inode 656 Connect to /lost+found? yes Inode 656 ref count is 2, should be 1. Fix? yes Unattached inode 657 Connect to /lost+found? yes Inode 657 ref count is 2, should be 1. Fix? yes Unattached inode 658 Connect to /lost+found? yes Inode 658 ref count is 2, should be 1. Fix? yes Unattached inode 659 Connect to /lost+found? yes Inode 659 ref count is 2, should be 1. Fix? yes Unattached inode 660 Connect to /lost+found? yes Inode 660 ref count is 2, should be 1. Fix? yes Unattached inode 661 Connect to /lost+found? yes Inode 661 ref count is 2, should be 1. Fix? yes Unattached inode 662 Connect to /lost+found? yes Inode 662 ref count is 2, should be 1. Fix? yes Unattached inode 663 Connect to /lost+found? yes Inode 663 ref count is 2, should be 1. Fix? yes Unattached inode 664 Connect to /lost+found? yes Inode 664 ref count is 2, should be 1. Fix? yes Unattached inode 665 Connect to /lost+found? yes Inode 665 ref count is 2, should be 1. Fix? yes Unattached inode 666 Connect to /lost+found? yes Inode 666 ref count is 2, should be 1. Fix? yes Unattached inode 667 Connect to /lost+found? yes Inode 667 ref count is 2, should be 1. Fix? yes Unattached inode 668 Connect to /lost+found? yes Inode 668 ref count is 2, should be 1. Fix? yes Unattached inode 669 Connect to /lost+found? yes Inode 669 ref count is 2, should be 1. Fix? yes Unattached inode 670 Connect to /lost+found? yes Inode 670 ref count is 2, should be 1. Fix? yes Unattached inode 671 Connect to /lost+found? yes Inode 671 ref count is 2, should be 1. Fix? yes Unattached inode 672 Connect to /lost+found? yes Inode 672 ref count is 2, should be 1. Fix? yes Unattached inode 673 Connect to /lost+found? yes Inode 673 ref count is 2, should be 1. Fix? yes Unattached inode 674 Connect to /lost+found? yes Inode 674 ref count is 2, should be 1. Fix? yes Unattached inode 675 Connect to /lost+found? yes Inode 675 ref count is 2, should be 1. Fix? yes Unattached inode 676 Connect to /lost+found? yes Inode 676 ref count is 2, should be 1. Fix? yes Unattached inode 677 Connect to /lost+found? yes Inode 677 ref count is 2, should be 1. Fix? yes Unattached inode 678 Connect to /lost+found? yes Inode 678 ref count is 2, should be 1. Fix? yes Unattached inode 679 Connect to /lost+found? yes Inode 679 ref count is 2, should be 1. Fix? yes Unattached inode 680 Connect to /lost+found? yes Inode 680 ref count is 2, should be 1. Fix? yes Unattached inode 681 Connect to /lost+found? yes Inode 681 ref count is 2, should be 1. Fix? yes Unattached inode 682 Connect to /lost+found? yes Inode 682 ref count is 2, should be 1. Fix? yes Unattached inode 683 Connect to /lost+found? yes Inode 683 ref count is 2, should be 1. Fix? yes Unattached inode 684 Connect to /lost+found? yes Inode 684 ref count is 2, should be 1. Fix? yes Unattached inode 685 Connect to /lost+found? yes Inode 685 ref count is 2, should be 1. Fix? yes Unattached inode 686 Connect to /lost+found? yes Inode 686 ref count is 2, should be 1. Fix? yes Unattached inode 687 Connect to /lost+found? yes Inode 687 ref count is 2, should be 1. Fix? yes Unattached inode 688 Connect to /lost+found? yes Inode 688 ref count is 2, should be 1. Fix? yes Unattached inode 689 Connect to /lost+found? yes Inode 689 ref count is 2, should be 1. Fix? yes Unattached inode 690 Connect to /lost+found? yes Inode 690 ref count is 2, should be 1. Fix? yes Unattached inode 691 Connect to /lost+found? yes Inode 691 ref count is 2, should be 1. Fix? yes Unattached inode 692 Connect to /lost+found? yes Inode 692 ref count is 2, should be 1. Fix? yes Unattached inode 693 Connect to /lost+found? yes Inode 693 ref count is 2, should be 1. Fix? yes Unattached inode 694 Connect to /lost+found? yes Inode 694 ref count is 2, should be 1. Fix? yes Unattached inode 695 Connect to /lost+found? yes Inode 695 ref count is 2, should be 1. Fix? yes Unattached inode 696 Connect to /lost+found? yes Inode 696 ref count is 2, should be 1. Fix? yes Unattached inode 697 Connect to /lost+found? yes Inode 697 ref count is 2, should be 1. Fix? yes Unattached inode 698 Connect to /lost+found? yes Inode 698 ref count is 2, should be 1. Fix? yes Unattached inode 699 Connect to /lost+found? yes Inode 699 ref count is 2, should be 1. Fix? yes Unattached inode 700 Connect to /lost+found? yes Inode 700 ref count is 2, should be 1. Fix? yes Unattached inode 701 Connect to /lost+found? yes Inode 701 ref count is 2, should be 1. Fix? yes Unattached inode 702 Connect to /lost+found? yes Inode 702 ref count is 2, should be 1. Fix? yes Unattached inode 703 Connect to /lost+found? yes Inode 703 ref count is 2, should be 1. Fix? yes Unattached inode 704 Connect to /lost+found? yes Inode 704 ref count is 2, should be 1. Fix? yes Unattached inode 705 Connect to /lost+found? yes Inode 705 ref count is 2, should be 1. Fix? yes Unattached inode 706 Connect to /lost+found? yes Inode 706 ref count is 2, should be 1. Fix? yes Unattached inode 707 Connect to /lost+found? yes Inode 707 ref count is 2, should be 1. Fix? yes Unattached inode 708 Connect to /lost+found? yes Inode 708 ref count is 2, should be 1. Fix? yes Unattached inode 709 Connect to /lost+found? yes Inode 709 ref count is 2, should be 1. Fix? yes Unattached inode 710 Connect to /lost+found? yes Inode 710 ref count is 2, should be 1. Fix? yes Unattached inode 711 Connect to /lost+found? yes Inode 711 ref count is 2, should be 1. Fix? yes Unattached inode 712 Connect to /lost+found? yes Inode 712 ref count is 2, should be 1. Fix? yes Unattached inode 713 Connect to /lost+found? yes Inode 713 ref count is 2, should be 1. Fix? yes Unattached inode 714 Connect to /lost+found? yes Inode 714 ref count is 2, should be 1. Fix? yes Unattached inode 715 Connect to /lost+found? yes Inode 715 ref count is 2, should be 1. Fix? yes Unattached inode 716 Connect to /lost+found? yes Inode 716 ref count is 2, should be 1. Fix? yes Unattached inode 717 Connect to /lost+found? yes Inode 717 ref count is 2, should be 1. Fix? yes Unattached inode 718 Connect to /lost+found? yes Inode 718 ref count is 2, should be 1. Fix? yes Unattached inode 719 Connect to /lost+found? yes Inode 719 ref count is 2, should be 1. Fix? yes Unattached inode 720 Connect to /lost+found? yes Inode 720 ref count is 2, should be 1. Fix? yes Unattached inode 721 Connect to /lost+found? yes Inode 721 ref count is 2, should be 1. Fix? yes Unattached inode 722 Connect to /lost+found? yes Inode 722 ref count is 2, should be 1. Fix? yes Unattached inode 723 Connect to /lost+found? yes Inode 723 ref count is 2, should be 1. Fix? yes Unattached inode 724 Connect to /lost+found? yes Inode 724 ref count is 2, should be 1. Fix? yes Unattached inode 725 Connect to /lost+found? yes Inode 725 ref count is 2, should be 1. Fix? yes Unattached inode 726 Connect to /lost+found? yes Inode 726 ref count is 2, should be 1. Fix? yes Unattached inode 727 Connect to /lost+found? yes Inode 727 ref count is 2, should be 1. Fix? yes Unattached inode 728 Connect to /lost+found? yes Inode 728 ref count is 2, should be 1. Fix? yes Unattached inode 729 Connect to /lost+found? yes Inode 729 ref count is 2, should be 1. Fix? yes Unattached inode 730 Connect to /lost+found? yes Inode 730 ref count is 2, should be 1. Fix? yes Unattached inode 731 Connect to /lost+found? yes Inode 731 ref count is 2, should be 1. Fix? yes Unattached inode 732 Connect to /lost+found? yes Inode 732 ref count is 2, should be 1. Fix? yes Unattached inode 733 Connect to /lost+found? yes Inode 733 ref count is 2, should be 1. Fix? yes Unattached inode 734 Connect to /lost+found? yes Inode 734 ref count is 2, should be 1. Fix? yes Unattached inode 735 Connect to /lost+found? yes Inode 735 ref count is 2, should be 1. Fix? yes Unattached inode 736 Connect to /lost+found? yes Inode 736 ref count is 2, should be 1. Fix? yes Unattached inode 737 Connect to /lost+found? yes Inode 737 ref count is 2, should be 1. Fix? yes Unattached inode 738 Connect to /lost+found? yes Inode 738 ref count is 2, should be 1. Fix? yes Unattached inode 739 Connect to /lost+found? yes Inode 739 ref count is 2, should be 1. Fix? yes Unattached inode 740 Connect to /lost+found? yes Inode 740 ref count is 2, should be 1. Fix? yes Unattached inode 741 Connect to /lost+found? yes Inode 741 ref count is 2, should be 1. Fix? yes Unattached inode 742 Connect to /lost+found? yes Inode 742 ref count is 2, should be 1. Fix? yes Unattached inode 743 Connect to /lost+found? yes Inode 743 ref count is 2, should be 1. Fix? yes Unattached inode 744 Connect to /lost+found? yes Inode 744 ref count is 2, should be 1. Fix? yes Unattached inode 745 Connect to /lost+found? yes Inode 745 ref count is 2, should be 1. Fix? yes Unattached inode 746 Connect to /lost+found? yes Inode 746 ref count is 2, should be 1. Fix? yes Unattached inode 747 Connect to /lost+found? yes Inode 747 ref count is 2, should be 1. Fix? yes Unattached inode 748 Connect to /lost+found? yes Inode 748 ref count is 2, should be 1. Fix? yes Unattached inode 749 Connect to /lost+found? yes Inode 749 ref count is 2, should be 1. Fix? yes Unattached inode 750 Connect to /lost+found? yes Inode 750 ref count is 2, should be 1. Fix? yes Unattached inode 751 Connect to /lost+found? yes Inode 751 ref count is 2, should be 1. Fix? yes Unattached inode 752 Connect to /lost+found? yes Inode 752 ref count is 2, should be 1. Fix? yes Unattached inode 753 Connect to /lost+found? yes Inode 753 ref count is 2, should be 1. Fix? yes Unattached inode 754 Connect to /lost+found? yes Inode 754 ref count is 2, should be 1. Fix? yes Unattached inode 755 Connect to /lost+found? yes Inode 755 ref count is 2, should be 1. Fix? yes Unattached inode 756 Connect to /lost+found? yes Inode 756 ref count is 2, should be 1. Fix? yes Unattached inode 757 Connect to /lost+found? yes Inode 757 ref count is 2, should be 1. Fix? yes Unattached inode 758 Connect to /lost+found? yes Inode 758 ref count is 2, should be 1. Fix? yes Unattached inode 759 Connect to /lost+found? yes Inode 759 ref count is 2, should be 1. Fix? yes Unattached inode 760 Connect to /lost+found? yes Inode 760 ref count is 2, should be 1. Fix? yes Unattached inode 761 Connect to /lost+found? yes Inode 761 ref count is 2, should be 1. Fix? yes Unattached inode 762 Connect to /lost+found? yes Inode 762 ref count is 2, should be 1. Fix? yes Unattached inode 763 Connect to /lost+found? yes Inode 763 ref count is 2, should be 1. Fix? yes Unattached inode 764 Connect to /lost+found? yes Inode 764 ref count is 2, should be 1. Fix? yes Unattached inode 765 Connect to /lost+found? yes Inode 765 ref count is 2, should be 1. Fix? yes Unattached inode 766 Connect to /lost+found? yes Inode 766 ref count is 2, should be 1. Fix? yes Unattached inode 767 Connect to /lost+found? yes Inode 767 ref count is 2, should be 1. Fix? yes Unattached inode 768 Connect to /lost+found? yes Inode 768 ref count is 2, should be 1. Fix? yes Unattached inode 769 Connect to /lost+found? yes Inode 769 ref count is 2, should be 1. Fix? yes Unattached inode 770 Connect to /lost+found? yes Inode 770 ref count is 2, should be 1. Fix? yes Unattached inode 771 Connect to /lost+found? yes Inode 771 ref count is 2, should be 1. Fix? yes Unattached inode 772 Connect to /lost+found? yes Inode 772 ref count is 2, should be 1. Fix? yes Unattached inode 773 Connect to /lost+found? yes Inode 773 ref count is 2, should be 1. Fix? yes Unattached inode 774 Connect to /lost+found? yes Inode 774 ref count is 2, should be 1. Fix? yes Unattached inode 775 Connect to /lost+found? yes Inode 775 ref count is 2, should be 1. Fix? yes Unattached inode 776 Connect to /lost+found? yes Inode 776 ref count is 2, should be 1. Fix? yes Unattached inode 777 Connect to /lost+found? yes Inode 777 ref count is 2, should be 1. Fix? yes Unattached inode 778 Connect to /lost+found? yes Inode 778 ref count is 2, should be 1. Fix? yes Unattached inode 779 Connect to /lost+found? yes Inode 779 ref count is 2, should be 1. Fix? yes Unattached inode 780 Connect to /lost+found? yes Inode 780 ref count is 2, should be 1. Fix? yes Unattached inode 781 Connect to /lost+found? yes Inode 781 ref count is 2, should be 1. Fix? yes Unattached inode 782 Connect to /lost+found? yes Inode 782 ref count is 2, should be 1. Fix? yes Unattached inode 783 Connect to /lost+found? yes Inode 783 ref count is 2, should be 1. Fix? yes Unattached inode 784 Connect to /lost+found? yes Inode 784 ref count is 2, should be 1. Fix? yes Unattached inode 785 Connect to /lost+found? yes Inode 785 ref count is 2, should be 1. Fix? yes Unattached inode 786 Connect to /lost+found? yes Inode 786 ref count is 2, should be 1. Fix? yes Unattached inode 787 Connect to /lost+found? yes Inode 787 ref count is 2, should be 1. Fix? yes Unattached inode 788 Connect to /lost+found? yes Inode 788 ref count is 2, should be 1. Fix? yes Unattached inode 789 Connect to /lost+found? yes Inode 789 ref count is 2, should be 1. Fix? yes Unattached inode 790 Connect to /lost+found? yes Inode 790 ref count is 2, should be 1. Fix? yes Unattached inode 791 Connect to /lost+found? yes Inode 791 ref count is 2, should be 1. Fix? yes Unattached inode 792 Connect to /lost+found? yes Inode 792 ref count is 2, should be 1. Fix? yes Unattached inode 793 Connect to /lost+found? yes Inode 793 ref count is 2, should be 1. Fix? yes Unattached inode 794 Connect to /lost+found? yes Inode 794 ref count is 2, should be 1. Fix? yes Unattached inode 795 Connect to /lost+found? yes Inode 795 ref count is 2, should be 1. Fix? yes Unattached inode 796 Connect to /lost+found? yes Inode 796 ref count is 2, should be 1. Fix? yes Unattached inode 797 Connect to /lost+found? yes Inode 797 ref count is 2, should be 1. Fix? yes Unattached inode 798 Connect to /lost+found? yes Inode 798 ref count is 2, should be 1. Fix? yes Unattached inode 799 Connect to /lost+found? yes Inode 799 ref count is 2, should be 1. Fix? yes Unattached inode 800 Connect to /lost+found? yes Inode 800 ref count is 2, should be 1. Fix? yes Unattached inode 801 Connect to /lost+found? yes Inode 801 ref count is 2, should be 1. Fix? yes Unattached inode 802 Connect to /lost+found? yes Inode 802 ref count is 2, should be 1. Fix? yes Unattached inode 803 Connect to /lost+found? yes Inode 803 ref count is 2, should be 1. Fix? yes Unattached inode 804 Connect to /lost+found? yes Inode 804 ref count is 2, should be 1. Fix? yes Unattached inode 805 Connect to /lost+found? yes Inode 805 ref count is 2, should be 1. Fix? yes Unattached inode 806 Connect to /lost+found? yes Inode 806 ref count is 2, should be 1. Fix? yes Unattached inode 807 Connect to /lost+found? yes Inode 807 ref count is 2, should be 1. Fix? yes Unattached inode 808 Connect to /lost+found? yes Inode 808 ref count is 2, should be 1. Fix? yes Unattached inode 809 Connect to /lost+found? yes Inode 809 ref count is 2, should be 1. Fix? yes Unattached inode 810 Connect to /lost+found? yes Inode 810 ref count is 2, should be 1. Fix? yes Unattached inode 811 Connect to /lost+found? yes Inode 811 ref count is 2, should be 1. Fix? yes Unattached inode 812 Connect to /lost+found? yes Inode 812 ref count is 2, should be 1. Fix? yes Unattached inode 813 Connect to /lost+found? yes Inode 813 ref count is 2, should be 1. Fix? yes Unattached inode 814 Connect to /lost+found? yes Inode 814 ref count is 2, should be 1. Fix? yes Unattached inode 815 Connect to /lost+found? yes Inode 815 ref count is 2, should be 1. Fix? yes Unattached inode 816 Connect to /lost+found? yes Inode 816 ref count is 2, should be 1. Fix? yes Unattached inode 817 Connect to /lost+found? yes Inode 817 ref count is 2, should be 1. Fix? yes Unattached inode 818 Connect to /lost+found? yes Inode 818 ref count is 2, should be 1. Fix? yes Unattached inode 819 Connect to /lost+found? yes Inode 819 ref count is 2, should be 1. Fix? yes Unattached inode 820 Connect to /lost+found? yes Inode 820 ref count is 2, should be 1. Fix? yes Unattached inode 821 Connect to /lost+found? yes Inode 821 ref count is 2, should be 1. Fix? yes Unattached inode 822 Connect to /lost+found? yes Inode 822 ref count is 2, should be 1. Fix? yes Unattached inode 823 Connect to /lost+found? yes Inode 823 ref count is 2, should be 1. Fix? yes Unattached inode 824 Connect to /lost+found? yes Inode 824 ref count is 2, should be 1. Fix? yes Unattached inode 825 Connect to /lost+found? yes Inode 825 ref count is 2, should be 1. Fix? yes Unattached inode 826 Connect to /lost+found? yes Inode 826 ref count is 2, should be 1. Fix? yes Unattached inode 827 Connect to /lost+found? yes Inode 827 ref count is 2, should be 1. Fix? yes Unattached inode 828 Connect to /lost+found? yes Inode 828 ref count is 2, should be 1. Fix? yes Unattached inode 829 Connect to /lost+found? yes Inode 829 ref count is 2, should be 1. Fix? yes Unattached inode 830 Connect to /lost+found? yes Inode 830 ref count is 2, should be 1. Fix? yes Unattached inode 831 Connect to /lost+found? yes Inode 831 ref count is 2, should be 1. Fix? yes Unattached inode 832 Connect to /lost+found? yes Inode 832 ref count is 2, should be 1. Fix? yes Unattached inode 833 Connect to /lost+found? yes Inode 833 ref count is 2, should be 1. Fix? yes Unattached inode 834 Connect to /lost+found? yes Inode 834 ref count is 2, should be 1. Fix? yes Unattached inode 835 Connect to /lost+found? yes Inode 835 ref count is 2, should be 1. Fix? yes Unattached inode 836 Connect to /lost+found? yes Inode 836 ref count is 2, should be 1. Fix? yes Unattached inode 837 Connect to /lost+found? yes Inode 837 ref count is 2, should be 1. Fix? yes Unattached inode 838 Connect to /lost+found? yes Inode 838 ref count is 2, should be 1. Fix? yes Unattached inode 839 Connect to /lost+found? yes Inode 839 ref count is 2, should be 1. Fix? yes Unattached inode 840 Connect to /lost+found? yes Inode 840 ref count is 2, should be 1. Fix? yes Unattached inode 841 Connect to /lost+found? yes Inode 841 ref count is 2, should be 1. Fix? yes Unattached inode 842 Connect to /lost+found? yes Inode 842 ref count is 2, should be 1. Fix? yes Unattached inode 843 Connect to /lost+found? yes Inode 843 ref count is 2, should be 1. Fix? yes Unattached inode 844 Connect to /lost+found? yes Inode 844 ref count is 2, should be 1. Fix? yes Unattached inode 845 Connect to /lost+found? yes Inode 845 ref count is 2, should be 1. Fix? yes Unattached inode 846 Connect to /lost+found? yes Inode 846 ref count is 2, should be 1. Fix? yes Unattached inode 847 Connect to /lost+found? yes Inode 847 ref count is 2, should be 1. Fix? yes Unattached inode 848 Connect to /lost+found? yes Inode 848 ref count is 2, should be 1. Fix? yes Unattached inode 849 Connect to /lost+found? yes Inode 849 ref count is 2, should be 1. Fix? yes Unattached inode 850 Connect to /lost+found? yes Inode 850 ref count is 2, should be 1. Fix? yes Unattached inode 851 Connect to /lost+found? yes Inode 851 ref count is 2, should be 1. Fix? yes Unattached inode 852 Connect to /lost+found? yes Inode 852 ref count is 2, should be 1. Fix? yes Unattached inode 853 Connect to /lost+found? yes Inode 853 ref count is 2, should be 1. Fix? yes Unattached inode 854 Connect to /lost+found? yes Inode 854 ref count is 2, should be 1. Fix? yes Unattached inode 855 Connect to /lost+found? yes Inode 855 ref count is 2, should be 1. Fix? yes Unattached inode 856 Connect to /lost+found? yes Inode 856 ref count is 2, should be 1. Fix? yes Unattached inode 857 Connect to /lost+found? yes Inode 857 ref count is 2, should be 1. Fix? yes Unattached inode 858 Connect to /lost+found? yes Inode 858 ref count is 2, should be 1. Fix? yes Unattached inode 859 Connect to /lost+found? yes Inode 859 ref count is 2, should be 1. Fix? yes Unattached inode 860 Connect to /lost+found? yes Inode 860 ref count is 2, should be 1. Fix? yes Unattached inode 861 Connect to /lost+found? yes Inode 861 ref count is 2, should be 1. Fix? yes Unattached inode 862 Connect to /lost+found? yes Inode 862 ref count is 2, should be 1. Fix? yes Unattached inode 863 Connect to /lost+found? yes Inode 863 ref count is 2, should be 1. Fix? yes Unattached inode 864 Connect to /lost+found? yes Inode 864 ref count is 2, should be 1. Fix? yes Unattached inode 865 Connect to /lost+found? yes Inode 865 ref count is 2, should be 1. Fix? yes Unattached inode 866 Connect to /lost+found? yes Inode 866 ref count is 2, should be 1. Fix? yes Unattached inode 867 Connect to /lost+found? yes Inode 867 ref count is 2, should be 1. Fix? yes Unattached inode 868 Connect to /lost+found? yes Inode 868 ref count is 2, should be 1. Fix? yes Unattached inode 869 Connect to /lost+found? yes Inode 869 ref count is 2, should be 1. Fix? yes Unattached inode 870 Connect to /lost+found? yes Inode 870 ref count is 2, should be 1. Fix? yes Unattached inode 871 Connect to /lost+found? yes Inode 871 ref count is 2, should be 1. Fix? yes Unattached inode 872 Connect to /lost+found? yes Inode 872 ref count is 2, should be 1. Fix? yes Unattached inode 873 Connect to /lost+found? yes Inode 873 ref count is 2, should be 1. Fix? yes Unattached inode 874 Connect to /lost+found? yes Inode 874 ref count is 2, should be 1. Fix? yes Unattached inode 875 Connect to /lost+found? yes Inode 875 ref count is 2, should be 1. Fix? yes Unattached inode 876 Connect to /lost+found? yes Inode 876 ref count is 2, should be 1. Fix? yes Unattached inode 877 Connect to /lost+found? yes Inode 877 ref count is 2, should be 1. Fix? yes Unattached inode 878 Connect to /lost+found? yes Inode 878 ref count is 2, should be 1. Fix? yes Unattached inode 879 Connect to /lost+found? yes Inode 879 ref count is 2, should be 1. Fix? yes Unattached inode 880 Connect to /lost+found? yes Inode 880 ref count is 2, should be 1. Fix? yes Unattached inode 881 Connect to /lost+found? yes Inode 881 ref count is 2, should be 1. Fix? yes Unattached inode 882 Connect to /lost+found? yes Inode 882 ref count is 2, should be 1. Fix? yes Unattached inode 883 Connect to /lost+found? yes Inode 883 ref count is 2, should be 1. Fix? yes Unattached inode 884 Connect to /lost+found? yes Inode 884 ref count is 2, should be 1. Fix? yes Unattached inode 885 Connect to /lost+found? yes Inode 885 ref count is 2, should be 1. Fix? yes Unattached inode 886 Connect to /lost+found? yes Inode 886 ref count is 2, should be 1. Fix? yes Unattached inode 887 Connect to /lost+found? yes Inode 887 ref count is 2, should be 1. Fix? yes Unattached inode 888 Connect to /lost+found? yes Inode 888 ref count is 2, should be 1. Fix? yes Unattached inode 889 Connect to /lost+found? yes Inode 889 ref count is 2, should be 1. Fix? yes Unattached inode 890 Connect to /lost+found? yes Inode 890 ref count is 2, should be 1. Fix? yes Unattached inode 891 Connect to /lost+found? yes Inode 891 ref count is 2, should be 1. Fix? yes Unattached inode 892 Connect to /lost+found? yes Inode 892 ref count is 2, should be 1. Fix? yes Unattached inode 893 Connect to /lost+found? yes Inode 893 ref count is 2, should be 1. Fix? yes Unattached inode 894 Connect to /lost+found? yes Inode 894 ref count is 2, should be 1. Fix? yes Unattached inode 895 Connect to /lost+found? yes Inode 895 ref count is 2, should be 1. Fix? yes Unattached inode 896 Connect to /lost+found? yes Inode 896 ref count is 2, should be 1. Fix? yes Unattached inode 897 Connect to /lost+found? yes Inode 897 ref count is 2, should be 1. Fix? yes Unattached inode 898 Connect to /lost+found? yes Inode 898 ref count is 2, should be 1. Fix? yes Unattached inode 899 Connect to /lost+found? yes Inode 899 ref count is 2, should be 1. Fix? yes Unattached inode 900 Connect to /lost+found? yes Inode 900 ref count is 2, should be 1. Fix? yes Unattached inode 901 Connect to /lost+found? yes Inode 901 ref count is 2, should be 1. Fix? yes Unattached inode 902 Connect to /lost+found? yes Inode 902 ref count is 2, should be 1. Fix? yes Unattached inode 903 Connect to /lost+found? yes Inode 903 ref count is 2, should be 1. Fix? yes Unattached inode 904 Connect to /lost+found? yes Inode 904 ref count is 2, should be 1. Fix? yes Unattached inode 905 Connect to /lost+found? yes Inode 905 ref count is 2, should be 1. Fix? yes Unattached inode 906 Connect to /lost+found? yes Inode 906 ref count is 2, should be 1. Fix? yes Unattached inode 907 Connect to /lost+found? yes Inode 907 ref count is 2, should be 1. Fix? yes Unattached inode 908 Connect to /lost+found? yes Inode 908 ref count is 2, should be 1. Fix? yes Unattached inode 909 Connect to /lost+found? yes Inode 909 ref count is 2, should be 1. Fix? yes Unattached inode 910 Connect to /lost+found? yes Inode 910 ref count is 2, should be 1. Fix? yes Unattached inode 911 Connect to /lost+found? yes Inode 911 ref count is 2, should be 1. Fix? yes Unattached inode 912 Connect to /lost+found? yes Inode 912 ref count is 2, should be 1. Fix? yes Unattached inode 913 Connect to /lost+found? yes Inode 913 ref count is 2, should be 1. Fix? yes Unattached inode 914 Connect to /lost+found? yes Inode 914 ref count is 2, should be 1. Fix? yes Unattached inode 915 Connect to /lost+found? yes Inode 915 ref count is 2, should be 1. Fix? yes Unattached inode 916 Connect to /lost+found? yes Inode 916 ref count is 2, should be 1. Fix? yes Unattached inode 917 Connect to /lost+found? yes Inode 917 ref count is 2, should be 1. Fix? yes Unattached inode 918 Connect to /lost+found? yes Inode 918 ref count is 2, should be 1. Fix? yes Unattached inode 919 Connect to /lost+found? yes Inode 919 ref count is 2, should be 1. Fix? yes Unattached inode 920 Connect to /lost+found? yes Inode 920 ref count is 2, should be 1. Fix? yes Unattached inode 921 Connect to /lost+found? yes Inode 921 ref count is 2, should be 1. Fix? yes Unattached inode 922 Connect to /lost+found? yes Inode 922 ref count is 2, should be 1. Fix? yes Unattached inode 923 Connect to /lost+found? yes Inode 923 ref count is 2, should be 1. Fix? yes Unattached inode 924 Connect to /lost+found? yes Inode 924 ref count is 2, should be 1. Fix? yes Unattached inode 925 Connect to /lost+found? yes Inode 925 ref count is 2, should be 1. Fix? yes Unattached inode 926 Connect to /lost+found? yes Inode 926 ref count is 2, should be 1. Fix? yes Unattached inode 927 Connect to /lost+found? yes Inode 927 ref count is 2, should be 1. Fix? yes Unattached inode 928 Connect to /lost+found? yes Inode 928 ref count is 2, should be 1. Fix? yes Unattached inode 929 Connect to /lost+found? yes Inode 929 ref count is 2, should be 1. Fix? yes Unattached inode 930 Connect to /lost+found? yes Inode 930 ref count is 2, should be 1. Fix? yes Unattached inode 931 Connect to /lost+found? yes Inode 931 ref count is 2, should be 1. Fix? yes Unattached inode 932 Connect to /lost+found? yes Inode 932 ref count is 2, should be 1. Fix? yes Unattached inode 933 Connect to /lost+found? yes Inode 933 ref count is 2, should be 1. Fix? yes Unattached inode 934 Connect to /lost+found? yes Inode 934 ref count is 2, should be 1. Fix? yes Unattached inode 935 Connect to /lost+found? yes Inode 935 ref count is 2, should be 1. Fix? yes Unattached inode 936 Connect to /lost+found? yes Inode 936 ref count is 2, should be 1. Fix? yes Unattached inode 937 Connect to /lost+found? yes Inode 937 ref count is 2, should be 1. Fix? yes Unattached inode 938 Connect to /lost+found? yes Inode 938 ref count is 2, should be 1. Fix? yes Unattached inode 939 Connect to /lost+found? yes Inode 939 ref count is 2, should be 1. Fix? yes Unattached inode 940 Connect to /lost+found? yes Inode 940 ref count is 2, should be 1. Fix? yes Unattached inode 941 Connect to /lost+found? yes Inode 941 ref count is 2, should be 1. Fix? yes Unattached inode 942 Connect to /lost+found? yes Inode 942 ref count is 2, should be 1. Fix? yes Unattached inode 943 Connect to /lost+found? yes Inode 943 ref count is 2, should be 1. Fix? yes Unattached inode 944 Connect to /lost+found? yes Inode 944 ref count is 2, should be 1. Fix? yes Unattached inode 945 Connect to /lost+found? yes Inode 945 ref count is 2, should be 1. Fix? yes Unattached inode 946 Connect to /lost+found? yes Inode 946 ref count is 2, should be 1. Fix? yes Unattached inode 947 Connect to /lost+found? yes Inode 947 ref count is 2, should be 1. Fix? yes Unattached inode 948 Connect to /lost+found? yes Inode 948 ref count is 2, should be 1. Fix? yes Unattached inode 949 Connect to /lost+found? yes Inode 949 ref count is 2, should be 1. Fix? yes Unattached inode 950 Connect to /lost+found? yes Inode 950 ref count is 2, should be 1. Fix? yes Unattached inode 951 Connect to /lost+found? yes Inode 951 ref count is 2, should be 1. Fix? yes Unattached inode 952 Connect to /lost+found? yes Inode 952 ref count is 2, should be 1. Fix? yes Unattached inode 953 Connect to /lost+found? yes Inode 953 ref count is 2, should be 1. Fix? yes Unattached inode 954 Connect to /lost+found? yes Inode 954 ref count is 2, should be 1. Fix? yes Unattached inode 955 Connect to /lost+found? yes Inode 955 ref count is 2, should be 1. Fix? yes Unattached inode 956 Connect to /lost+found? yes Inode 956 ref count is 2, should be 1. Fix? yes Unattached inode 957 Connect to /lost+found? yes Inode 957 ref count is 2, should be 1. Fix? yes Unattached inode 958 Connect to /lost+found? yes Inode 958 ref count is 2, should be 1. Fix? yes Unattached inode 959 Connect to /lost+found? yes Inode 959 ref count is 2, should be 1. Fix? yes Unattached inode 960 Connect to /lost+found? yes Inode 960 ref count is 2, should be 1. Fix? yes Unattached inode 961 Connect to /lost+found? yes Inode 961 ref count is 2, should be 1. Fix? yes Unattached inode 962 Connect to /lost+found? yes Inode 962 ref count is 2, should be 1. Fix? yes Unattached inode 963 Connect to /lost+found? yes Inode 963 ref count is 2, should be 1. Fix? yes Unattached inode 964 Connect to /lost+found? yes Inode 964 ref count is 2, should be 1. Fix? yes Unattached inode 965 Connect to /lost+found? yes Inode 965 ref count is 2, should be 1. Fix? yes Unattached inode 966 Connect to /lost+found? yes Inode 966 ref count is 2, should be 1. Fix? yes Unattached inode 967 Connect to /lost+found? yes Inode 967 ref count is 2, should be 1. Fix? yes Unattached inode 968 Connect to /lost+found? yes Inode 968 ref count is 2, should be 1. Fix? yes Unattached inode 969 Connect to /lost+found? yes Inode 969 ref count is 2, should be 1. Fix? yes Unattached inode 970 Connect to /lost+found? yes Inode 970 ref count is 2, should be 1. Fix? yes Unattached inode 971 Connect to /lost+found? yes Inode 971 ref count is 2, should be 1. Fix? yes Unattached inode 972 Connect to /lost+found? yes Inode 972 ref count is 2, should be 1. Fix? yes Unattached inode 973 Connect to /lost+found? yes Inode 973 ref count is 2, should be 1. Fix? yes Unattached inode 974 Connect to /lost+found? yes Inode 974 ref count is 2, should be 1. Fix? yes Unattached inode 975 Connect to /lost+found? yes Inode 975 ref count is 2, should be 1. Fix? yes Unattached inode 976 Connect to /lost+found? yes Inode 976 ref count is 2, should be 1. Fix? yes Unattached inode 977 Connect to /lost+found? yes Inode 977 ref count is 2, should be 1. Fix? yes Unattached inode 978 Connect to /lost+found? yes Inode 978 ref count is 2, should be 1. Fix? yes Unattached inode 979 Connect to /lost+found? yes Inode 979 ref count is 2, should be 1. Fix? yes Unattached inode 980 Connect to /lost+found? yes Inode 980 ref count is 2, should be 1. Fix? yes Unattached inode 981 Connect to /lost+found? yes Inode 981 ref count is 2, should be 1. Fix? yes Unattached inode 982 Connect to /lost+found? yes Inode 982 ref count is 2, should be 1. Fix? yes Unattached inode 983 Connect to /lost+found? yes Inode 983 ref count is 2, should be 1. Fix? yes Unattached inode 984 Connect to /lost+found? yes Inode 984 ref count is 2, should be 1. Fix? yes Unattached inode 985 Connect to /lost+found? yes Inode 985 ref count is 2, should be 1. Fix? yes Unattached inode 986 Connect to /lost+found? yes Inode 986 ref count is 2, should be 1. Fix? yes Unattached inode 987 Connect to /lost+found? yes Inode 987 ref count is 2, should be 1. Fix? yes Unattached inode 988 Connect to /lost+found? yes Inode 988 ref count is 2, should be 1. Fix? yes Unattached inode 989 Connect to /lost+found? yes Inode 989 ref count is 2, should be 1. Fix? yes Unattached inode 990 Connect to /lost+found? yes Inode 990 ref count is 2, should be 1. Fix? yes Unattached inode 991 Connect to /lost+found? yes Inode 991 ref count is 2, should be 1. Fix? yes Unattached inode 992 Connect to /lost+found? yes Inode 992 ref count is 2, should be 1. Fix? yes Unattached inode 993 Connect to /lost+found? yes Inode 993 ref count is 2, should be 1. Fix? yes Unattached inode 994 Connect to /lost+found? yes Inode 994 ref count is 2, should be 1. Fix? yes Unattached inode 995 Connect to /lost+found? yes Inode 995 ref count is 2, should be 1. Fix? yes Unattached inode 996 Connect to /lost+found? yes Inode 996 ref count is 2, should be 1. Fix? yes Unattached inode 997 Connect to /lost+found? yes Inode 997 ref count is 2, should be 1. Fix? yes Unattached inode 998 Connect to /lost+found? yes Inode 998 ref count is 2, should be 1. Fix? yes Unattached inode 999 Connect to /lost+found? yes Inode 999 ref count is 2, should be 1. Fix? yes Unattached inode 1000 Connect to /lost+found? yes Inode 1000 ref count is 2, should be 1. Fix? yes Unattached inode 1001 Connect to /lost+found? yes Inode 1001 ref count is 2, should be 1. Fix? yes Unattached inode 1002 Connect to /lost+found? yes Inode 1002 ref count is 2, should be 1. Fix? yes Unattached inode 1003 Connect to /lost+found? yes Inode 1003 ref count is 2, should be 1. Fix? yes Unattached inode 1004 Connect to /lost+found? yes Inode 1004 ref count is 2, should be 1. Fix? yes Unattached inode 1005 Connect to /lost+found? yes Inode 1005 ref count is 2, should be 1. Fix? yes Unattached inode 1006 Connect to /lost+found? yes Inode 1006 ref count is 2, should be 1. Fix? yes Unattached inode 1007 Connect to /lost+found? yes Inode 1007 ref count is 2, should be 1. Fix? yes Unattached inode 1008 Connect to /lost+found? yes Inode 1008 ref count is 2, should be 1. Fix? yes Unattached inode 1009 Connect to /lost+found? yes Inode 1009 ref count is 2, should be 1. Fix? yes Unattached inode 1010 Connect to /lost+found? yes Inode 1010 ref count is 2, should be 1. Fix? yes Unattached inode 1011 Connect to /lost+found? yes Inode 1011 ref count is 2, should be 1. Fix? yes Unattached inode 1012 Connect to /lost+found? yes Inode 1012 ref count is 2, should be 1. Fix? yes Unattached inode 1013 Connect to /lost+found? yes Inode 1013 ref count is 2, should be 1. Fix? yes Unattached inode 1014 Connect to /lost+found? yes Inode 1014 ref count is 2, should be 1. Fix? yes Unattached inode 1015 Connect to /lost+found? yes Inode 1015 ref count is 2, should be 1. Fix? yes Unattached inode 1016 Connect to /lost+found? yes Inode 1016 ref count is 2, should be 1. Fix? yes Unattached inode 1017 Connect to /lost+found? yes Inode 1017 ref count is 2, should be 1. Fix? yes Unattached inode 1018 Connect to /lost+found? yes Inode 1018 ref count is 2, should be 1. Fix? yes Unattached inode 1019 Connect to /lost+found? yes Inode 1019 ref count is 2, should be 1. Fix? yes Unattached inode 1020 Connect to /lost+found? yes Inode 1020 ref count is 2, should be 1. Fix? yes Unattached inode 1021 Connect to /lost+found? yes Inode 1021 ref count is 2, should be 1. Fix? yes Unattached inode 1022 Connect to /lost+found? yes Inode 1022 ref count is 2, should be 1. Fix? yes Unattached inode 1023 Connect to /lost+found? yes Inode 1023 ref count is 2, should be 1. Fix? yes Unattached inode 1024 Connect to /lost+found? yes Inode 1024 ref count is 2, should be 1. Fix? yes Unattached inode 1025 Connect to /lost+found? yes Inode 1025 ref count is 2, should be 1. Fix? yes Unattached inode 1026 Connect to /lost+found? yes Inode 1026 ref count is 2, should be 1. Fix? yes Unattached inode 1027 Connect to /lost+found? yes Inode 1027 ref count is 2, should be 1. Fix? yes Unattached inode 1028 Connect to /lost+found? yes Inode 1028 ref count is 2, should be 1. Fix? yes Unattached inode 1029 Connect to /lost+found? yes Inode 1029 ref count is 2, should be 1. Fix? yes Unattached inode 1030 Connect to /lost+found? yes Inode 1030 ref count is 2, should be 1. Fix? yes Unattached inode 1031 Connect to /lost+found? yes Inode 1031 ref count is 2, should be 1. Fix? yes Unattached inode 1032 Connect to /lost+found? yes Inode 1032 ref count is 2, should be 1. Fix? yes Unattached inode 1033 Connect to /lost+found? yes Inode 1033 ref count is 2, should be 1. Fix? yes Unattached inode 1034 Connect to /lost+found? yes Inode 1034 ref count is 2, should be 1. Fix? yes Unattached inode 1035 Connect to /lost+found? yes Inode 1035 ref count is 2, should be 1. Fix? yes Unattached inode 1036 Connect to /lost+found? yes Inode 1036 ref count is 2, should be 1. Fix? yes Unattached inode 1037 Connect to /lost+found? yes Inode 1037 ref count is 2, should be 1. Fix? yes Unattached inode 1038 Connect to /lost+found? yes Inode 1038 ref count is 2, should be 1. Fix? yes Unattached inode 1039 Connect to /lost+found? yes Inode 1039 ref count is 2, should be 1. Fix? yes Unattached inode 1040 Connect to /lost+found? yes Inode 1040 ref count is 2, should be 1. Fix? yes Unattached inode 1041 Connect to /lost+found? yes Inode 1041 ref count is 2, should be 1. Fix? yes Unattached inode 1042 Connect to /lost+found? yes Inode 1042 ref count is 2, should be 1. Fix? yes Unattached inode 1043 Connect to /lost+found? yes Inode 1043 ref count is 2, should be 1. Fix? yes Unattached inode 1044 Connect to /lost+found? yes Inode 1044 ref count is 2, should be 1. Fix? yes Unattached inode 1045 Connect to /lost+found? yes Inode 1045 ref count is 2, should be 1. Fix? yes Unattached inode 1046 Connect to /lost+found? yes Inode 1046 ref count is 2, should be 1. Fix? yes Unattached inode 1047 Connect to /lost+found? yes Inode 1047 ref count is 2, should be 1. Fix? yes Unattached inode 1048 Connect to /lost+found? yes Inode 1048 ref count is 2, should be 1. Fix? yes Unattached inode 1049 Connect to /lost+found? yes Inode 1049 ref count is 2, should be 1. Fix? yes Unattached inode 1050 Connect to /lost+found? yes Inode 1050 ref count is 2, should be 1. Fix? yes Unattached inode 1051 Connect to /lost+found? yes Inode 1051 ref count is 2, should be 1. Fix? yes Unattached inode 1052 Connect to /lost+found? yes Inode 1052 ref count is 2, should be 1. Fix? yes Unattached inode 1053 Connect to /lost+found? yes Inode 1053 ref count is 2, should be 1. Fix? yes Unattached inode 1054 Connect to /lost+found? yes Inode 1054 ref count is 2, should be 1. Fix? yes Unattached inode 1055 Connect to /lost+found? yes Inode 1055 ref count is 2, should be 1. Fix? yes Unattached inode 1056 Connect to /lost+found? yes Inode 1056 ref count is 2, should be 1. Fix? yes Unattached inode 1057 Connect to /lost+found? yes Inode 1057 ref count is 2, should be 1. Fix? yes Unattached inode 1058 Connect to /lost+found? yes Inode 1058 ref count is 2, should be 1. Fix? yes Unattached inode 1059 Connect to /lost+found? yes Inode 1059 ref count is 2, should be 1. Fix? yes Unattached inode 1060 Connect to /lost+found? yes Inode 1060 ref count is 2, should be 1. Fix? yes Unattached inode 1061 Connect to /lost+found? yes Inode 1061 ref count is 2, should be 1. Fix? yes Unattached inode 1062 Connect to /lost+found? yes Inode 1062 ref count is 2, should be 1. Fix? yes Unattached inode 1063 Connect to /lost+found? yes Inode 1063 ref count is 2, should be 1. Fix? yes Unattached inode 1064 Connect to /lost+found? yes Inode 1064 ref count is 2, should be 1. Fix? yes Unattached inode 1065 Connect to /lost+found? yes Inode 1065 ref count is 2, should be 1. Fix? yes Unattached inode 1066 Connect to /lost+found? yes Inode 1066 ref count is 2, should be 1. Fix? yes Unattached inode 1067 Connect to /lost+found? yes Inode 1067 ref count is 2, should be 1. Fix? yes Unattached inode 1068 Connect to /lost+found? yes Inode 1068 ref count is 2, should be 1. Fix? yes Unattached inode 1069 Connect to /lost+found? yes Inode 1069 ref count is 2, should be 1. Fix? yes Unattached inode 1070 Connect to /lost+found? yes Inode 1070 ref count is 2, should be 1. Fix? yes Unattached inode 1071 Connect to /lost+found? yes Inode 1071 ref count is 2, should be 1. Fix? yes Unattached inode 1072 Connect to /lost+found? yes Inode 1072 ref count is 2, should be 1. Fix? yes Unattached inode 1073 Connect to /lost+found? yes Inode 1073 ref count is 2, should be 1. Fix? yes Unattached inode 1074 Connect to /lost+found? yes Inode 1074 ref count is 2, should be 1. Fix? yes Unattached inode 1075 Connect to /lost+found? yes Inode 1075 ref count is 2, should be 1. Fix? yes Unattached inode 1076 Connect to /lost+found? yes Inode 1076 ref count is 2, should be 1. Fix? yes Unattached inode 1077 Connect to /lost+found? yes Inode 1077 ref count is 2, should be 1. Fix? yes Unattached inode 1078 Connect to /lost+found? yes Inode 1078 ref count is 2, should be 1. Fix? yes Unattached inode 1079 Connect to /lost+found? yes Inode 1079 ref count is 2, should be 1. Fix? yes Unattached inode 1080 Connect to /lost+found? yes Inode 1080 ref count is 2, should be 1. Fix? yes Unattached inode 1081 Connect to /lost+found? yes Inode 1081 ref count is 2, should be 1. Fix? yes Unattached inode 1082 Connect to /lost+found? yes Inode 1082 ref count is 2, should be 1. Fix? yes Unattached inode 1083 Connect to /lost+found? yes Inode 1083 ref count is 2, should be 1. Fix? yes Unattached inode 1084 Connect to /lost+found? yes Inode 1084 ref count is 2, should be 1. Fix? yes Unattached inode 1085 Connect to /lost+found? yes Inode 1085 ref count is 2, should be 1. Fix? yes Unattached inode 1086 Connect to /lost+found? yes Inode 1086 ref count is 2, should be 1. Fix? yes Unattached inode 1087 Connect to /lost+found? yes Inode 1087 ref count is 2, should be 1. Fix? yes Unattached inode 1088 Connect to /lost+found? yes Inode 1088 ref count is 2, should be 1. Fix? yes Unattached inode 1089 Connect to /lost+found? yes Inode 1089 ref count is 2, should be 1. Fix? yes Unattached inode 1090 Connect to /lost+found? yes Inode 1090 ref count is 2, should be 1. Fix? yes Unattached inode 1091 Connect to /lost+found? yes Inode 1091 ref count is 2, should be 1. Fix? yes Unattached inode 1092 Connect to /lost+found? yes Inode 1092 ref count is 2, should be 1. Fix? yes Unattached inode 1093 Connect to /lost+found? yes Inode 1093 ref count is 2, should be 1. Fix? yes Unattached inode 1094 Connect to /lost+found? yes Inode 1094 ref count is 2, should be 1. Fix? yes Unattached inode 1095 Connect to /lost+found? yes Inode 1095 ref count is 2, should be 1. Fix? yes Unattached inode 1096 Connect to /lost+found? yes Inode 1096 ref count is 2, should be 1. Fix? yes Unattached inode 1097 Connect to /lost+found? yes Inode 1097 ref count is 2, should be 1. Fix? yes Unattached inode 1098 Connect to /lost+found? yes Inode 1098 ref count is 2, should be 1. Fix? yes Unattached inode 1099 Connect to /lost+found? yes Inode 1099 ref count is 2, should be 1. Fix? yes Unattached inode 1100 Connect to /lost+found? yes Inode 1100 ref count is 2, should be 1. Fix? yes Unattached inode 1101 Connect to /lost+found? yes Inode 1101 ref count is 2, should be 1. Fix? yes Unattached inode 1102 Connect to /lost+found? yes Inode 1102 ref count is 2, should be 1. Fix? yes Unattached inode 1103 Connect to /lost+found? yes Inode 1103 ref count is 2, should be 1. Fix? yes Unattached inode 1104 Connect to /lost+found? yes Inode 1104 ref count is 2, should be 1. Fix? yes Unattached inode 1105 Connect to /lost+found? yes Inode 1105 ref count is 2, should be 1. Fix? yes Unattached inode 1106 Connect to /lost+found? yes Inode 1106 ref count is 2, should be 1. Fix? yes Unattached inode 1107 Connect to /lost+found? yes Inode 1107 ref count is 2, should be 1. Fix? yes Unattached inode 1108 Connect to /lost+found? yes Inode 1108 ref count is 2, should be 1. Fix? yes Unattached inode 1109 Connect to /lost+found? yes Inode 1109 ref count is 2, should be 1. Fix? yes Unattached inode 1110 Connect to /lost+found? yes Inode 1110 ref count is 2, should be 1. Fix? yes Unattached inode 1111 Connect to /lost+found? yes Inode 1111 ref count is 2, should be 1. Fix? yes Unattached inode 1112 Connect to /lost+found? yes Inode 1112 ref count is 2, should be 1. Fix? yes Unattached inode 1113 Connect to /lost+found? yes Inode 1113 ref count is 2, should be 1. Fix? yes Unattached inode 1114 Connect to /lost+found? yes Inode 1114 ref count is 2, should be 1. Fix? yes Unattached inode 1115 Connect to /lost+found? yes Inode 1115 ref count is 2, should be 1. Fix? yes Unattached inode 1116 Connect to /lost+found? yes Inode 1116 ref count is 2, should be 1. Fix? yes Unattached inode 1117 Connect to /lost+found? yes Inode 1117 ref count is 2, should be 1. Fix? yes Unattached inode 1118 Connect to /lost+found? yes Inode 1118 ref count is 2, should be 1. Fix? yes Unattached inode 1119 Connect to /lost+found? yes Inode 1119 ref count is 2, should be 1. Fix? yes Unattached inode 1120 Connect to /lost+found? yes Inode 1120 ref count is 2, should be 1. Fix? yes Unattached inode 1121 Connect to /lost+found? yes Inode 1121 ref count is 2, should be 1. Fix? yes Unattached inode 1122 Connect to /lost+found? yes Inode 1122 ref count is 2, should be 1. Fix? yes Unattached inode 1123 Connect to /lost+found? yes Inode 1123 ref count is 2, should be 1. Fix? yes Unattached inode 1124 Connect to /lost+found? yes Inode 1124 ref count is 2, should be 1. Fix? yes Unattached inode 1125 Connect to /lost+found? yes Inode 1125 ref count is 2, should be 1. Fix? yes Unattached inode 1126 Connect to /lost+found? yes Inode 1126 ref count is 2, should be 1. Fix? yes Unattached inode 1127 Connect to /lost+found? yes Inode 1127 ref count is 2, should be 1. Fix? yes Unattached inode 1128 Connect to /lost+found? yes Inode 1128 ref count is 2, should be 1. Fix? yes Unattached inode 1129 Connect to /lost+found? yes Inode 1129 ref count is 2, should be 1. Fix? yes Unattached inode 1130 Connect to /lost+found? yes Inode 1130 ref count is 2, should be 1. Fix? yes Unattached inode 1131 Connect to /lost+found? yes Inode 1131 ref count is 2, should be 1. Fix? yes Unattached inode 1132 Connect to /lost+found? yes Inode 1132 ref count is 2, should be 1. Fix? yes Unattached inode 1133 Connect to /lost+found? yes Inode 1133 ref count is 2, should be 1. Fix? yes Unattached inode 1134 Connect to /lost+found? yes Inode 1134 ref count is 2, should be 1. Fix? yes Unattached inode 1135 Connect to /lost+found? yes Inode 1135 ref count is 2, should be 1. Fix? yes Unattached inode 1136 Connect to /lost+found? yes Inode 1136 ref count is 2, should be 1. Fix? yes Unattached inode 1137 Connect to /lost+found? yes Inode 1137 ref count is 2, should be 1. Fix? yes Unattached inode 1138 Connect to /lost+found? yes Inode 1138 ref count is 2, should be 1. Fix? yes Unattached inode 1139 Connect to /lost+found? yes Inode 1139 ref count is 2, should be 1. Fix? yes Unattached inode 1140 Connect to /lost+found? yes Inode 1140 ref count is 2, should be 1. Fix? yes Unattached inode 1141 Connect to /lost+found? yes Inode 1141 ref count is 2, should be 1. Fix? yes Unattached inode 1142 Connect to /lost+found? yes Inode 1142 ref count is 2, should be 1. Fix? yes Unattached inode 1143 Connect to /lost+found? yes Inode 1143 ref count is 2, should be 1. Fix? yes Unattached inode 1144 Connect to /lost+found? yes Inode 1144 ref count is 2, should be 1. Fix? yes Unattached inode 1145 Connect to /lost+found? yes Inode 1145 ref count is 2, should be 1. Fix? yes Unattached inode 1146 Connect to /lost+found? yes Inode 1146 ref count is 2, should be 1. Fix? yes Unattached inode 1147 Connect to /lost+found? yes Inode 1147 ref count is 2, should be 1. Fix? yes Unattached inode 1148 Connect to /lost+found? yes Inode 1148 ref count is 2, should be 1. Fix? yes Unattached inode 1149 Connect to /lost+found? yes Inode 1149 ref count is 2, should be 1. Fix? yes Unattached inode 1150 Connect to /lost+found? yes Inode 1150 ref count is 2, should be 1. Fix? yes Unattached inode 1151 Connect to /lost+found? yes Inode 1151 ref count is 2, should be 1. Fix? yes Unattached inode 1152 Connect to /lost+found? yes Inode 1152 ref count is 2, should be 1. Fix? yes Unattached inode 1153 Connect to /lost+found? yes Inode 1153 ref count is 2, should be 1. Fix? yes Unattached inode 1154 Connect to /lost+found? yes Inode 1154 ref count is 2, should be 1. Fix? yes Unattached inode 1155 Connect to /lost+found? yes Inode 1155 ref count is 2, should be 1. Fix? yes Unattached inode 1156 Connect to /lost+found? yes Inode 1156 ref count is 2, should be 1. Fix? yes Unattached inode 1157 Connect to /lost+found? yes Inode 1157 ref count is 2, should be 1. Fix? yes Unattached inode 1158 Connect to /lost+found? yes Inode 1158 ref count is 2, should be 1. Fix? yes Unattached inode 1159 Connect to /lost+found? yes Inode 1159 ref count is 2, should be 1. Fix? yes Unattached inode 1160 Connect to /lost+found? yes Inode 1160 ref count is 2, should be 1. Fix? yes Unattached inode 1161 Connect to /lost+found? yes Inode 1161 ref count is 2, should be 1. Fix? yes Unattached inode 1162 Connect to /lost+found? yes Inode 1162 ref count is 2, should be 1. Fix? yes Unattached inode 1163 Connect to /lost+found? yes Inode 1163 ref count is 2, should be 1. Fix? yes Unattached inode 1164 Connect to /lost+found? yes Inode 1164 ref count is 2, should be 1. Fix? yes Unattached inode 1165 Connect to /lost+found? yes Inode 1165 ref count is 2, should be 1. Fix? yes Unattached inode 1166 Connect to /lost+found? yes Inode 1166 ref count is 2, should be 1. Fix? yes Unattached inode 1167 Connect to /lost+found? yes Inode 1167 ref count is 2, should be 1. Fix? yes Unattached inode 1168 Connect to /lost+found? yes Inode 1168 ref count is 2, should be 1. Fix? yes Unattached inode 1169 Connect to /lost+found? yes Inode 1169 ref count is 2, should be 1. Fix? yes Unattached inode 1170 Connect to /lost+found? yes Inode 1170 ref count is 2, should be 1. Fix? yes Unattached inode 1171 Connect to /lost+found? yes Inode 1171 ref count is 2, should be 1. Fix? yes Unattached inode 1172 Connect to /lost+found? yes Inode 1172 ref count is 2, should be 1. Fix? yes Unattached inode 1173 Connect to /lost+found? yes Inode 1173 ref count is 2, should be 1. Fix? yes Unattached inode 1174 Connect to /lost+found? yes Inode 1174 ref count is 2, should be 1. Fix? yes Unattached inode 1175 Connect to /lost+found? yes Inode 1175 ref count is 2, should be 1. Fix? yes Unattached inode 1176 Connect to /lost+found? yes Inode 1176 ref count is 2, should be 1. Fix? yes Unattached inode 1177 Connect to /lost+found? yes Inode 1177 ref count is 2, should be 1. Fix? yes Unattached inode 1178 Connect to /lost+found? yes Inode 1178 ref count is 2, should be 1. Fix? yes Unattached inode 1179 Connect to /lost+found? yes Inode 1179 ref count is 2, should be 1. Fix? yes Unattached inode 1180 Connect to /lost+found? yes Inode 1180 ref count is 2, should be 1. Fix? yes Unattached inode 1181 Connect to /lost+found? yes Inode 1181 ref count is 2, should be 1. Fix? yes Unattached inode 1182 Connect to /lost+found? yes Inode 1182 ref count is 2, should be 1. Fix? yes Unattached inode 1183 Connect to /lost+found? yes Inode 1183 ref count is 2, should be 1. Fix? yes Unattached inode 1184 Connect to /lost+found? yes Inode 1184 ref count is 2, should be 1. Fix? yes Unattached inode 1185 Connect to /lost+found? yes Inode 1185 ref count is 2, should be 1. Fix? yes Unattached inode 1186 Connect to /lost+found? yes Inode 1186 ref count is 2, should be 1. Fix? yes Unattached inode 1187 Connect to /lost+found? yes Inode 1187 ref count is 2, should be 1. Fix? yes Unattached inode 1188 Connect to /lost+found? yes Inode 1188 ref count is 2, should be 1. Fix? yes Unattached inode 1189 Connect to /lost+found? yes Inode 1189 ref count is 2, should be 1. Fix? yes Unattached inode 1190 Connect to /lost+found? yes Inode 1190 ref count is 2, should be 1. Fix? yes Unattached inode 1191 Connect to /lost+found? yes Inode 1191 ref count is 2, should be 1. Fix? yes Unattached inode 1192 Connect to /lost+found? yes Inode 1192 ref count is 2, should be 1. Fix? yes Unattached inode 1193 Connect to /lost+found? yes Inode 1193 ref count is 2, should be 1. Fix? yes Unattached inode 1194 Connect to /lost+found? yes Inode 1194 ref count is 2, should be 1. Fix? yes Unattached inode 1195 Connect to /lost+found? yes Inode 1195 ref count is 2, should be 1. Fix? yes Unattached inode 1196 Connect to /lost+found? yes Inode 1196 ref count is 2, should be 1. Fix? yes Unattached inode 1197 Connect to /lost+found? yes Inode 1197 ref count is 2, should be 1. Fix? yes Unattached inode 1198 Connect to /lost+found? yes Inode 1198 ref count is 2, should be 1. Fix? yes Unattached inode 1199 Connect to /lost+found? yes Inode 1199 ref count is 2, should be 1. Fix? yes Unattached inode 1200 Connect to /lost+found? yes Inode 1200 ref count is 2, should be 1. Fix? yes Unattached inode 1201 Connect to /lost+found? yes Inode 1201 ref count is 2, should be 1. Fix? yes Unattached inode 1202 Connect to /lost+found? yes Inode 1202 ref count is 2, should be 1. Fix? yes Unattached inode 1203 Connect to /lost+found? yes Inode 1203 ref count is 2, should be 1. Fix? yes Unattached inode 1204 Connect to /lost+found? yes Inode 1204 ref count is 2, should be 1. Fix? yes Unattached inode 1205 Connect to /lost+found? yes Inode 1205 ref count is 2, should be 1. Fix? yes Unattached inode 1206 Connect to /lost+found? yes Inode 1206 ref count is 2, should be 1. Fix? yes Unattached inode 1207 Connect to /lost+found? yes Inode 1207 ref count is 2, should be 1. Fix? yes Unattached inode 1208 Connect to /lost+found? yes Inode 1208 ref count is 2, should be 1. Fix? yes Unattached inode 1209 Connect to /lost+found? yes Inode 1209 ref count is 2, should be 1. Fix? yes Unattached inode 1210 Connect to /lost+found? yes Inode 1210 ref count is 2, should be 1. Fix? yes Unattached inode 1211 Connect to /lost+found? yes Inode 1211 ref count is 2, should be 1. Fix? yes Unattached inode 1212 Connect to /lost+found? yes Inode 1212 ref count is 2, should be 1. Fix? yes Unattached inode 1213 Connect to /lost+found? yes Inode 1213 ref count is 2, should be 1. Fix? yes Unattached inode 1214 Connect to /lost+found? yes Inode 1214 ref count is 2, should be 1. Fix? yes Unattached inode 1215 Connect to /lost+found? yes Inode 1215 ref count is 2, should be 1. Fix? yes Unattached inode 1216 Connect to /lost+found? yes Inode 1216 ref count is 2, should be 1. Fix? yes Unattached inode 1217 Connect to /lost+found? yes Inode 1217 ref count is 2, should be 1. Fix? yes Unattached inode 1218 Connect to /lost+found? yes Inode 1218 ref count is 2, should be 1. Fix? yes Unattached inode 1219 Connect to /lost+found? yes Inode 1219 ref count is 2, should be 1. Fix? yes Unattached inode 1220 Connect to /lost+found? yes Inode 1220 ref count is 2, should be 1. Fix? yes Unattached inode 1221 Connect to /lost+found? yes Inode 1221 ref count is 2, should be 1. Fix? yes Unattached inode 1222 Connect to /lost+found? yes Inode 1222 ref count is 2, should be 1. Fix? yes Unattached inode 1223 Connect to /lost+found? yes Inode 1223 ref count is 2, should be 1. Fix? yes Unattached inode 1224 Connect to /lost+found? yes Inode 1224 ref count is 2, should be 1. Fix? yes Unattached inode 1225 Connect to /lost+found? yes Inode 1225 ref count is 2, should be 1. Fix? yes Unattached inode 1226 Connect to /lost+found? yes Inode 1226 ref count is 2, should be 1. Fix? yes Unattached inode 1227 Connect to /lost+found? yes Inode 1227 ref count is 2, should be 1. Fix? yes Unattached inode 1228 Connect to /lost+found? yes Inode 1228 ref count is 2, should be 1. Fix? yes Unattached inode 1229 Connect to /lost+found? yes Inode 1229 ref count is 2, should be 1. Fix? yes Unattached inode 1230 Connect to /lost+found? yes Inode 1230 ref count is 2, should be 1. Fix? yes Unattached inode 1231 Connect to /lost+found? yes Inode 1231 ref count is 2, should be 1. Fix? yes Unattached inode 1232 Connect to /lost+found? yes Inode 1232 ref count is 2, should be 1. Fix? yes Unattached inode 1233 Connect to /lost+found? yes Inode 1233 ref count is 2, should be 1. Fix? yes Unattached inode 1234 Connect to /lost+found? yes Inode 1234 ref count is 2, should be 1. Fix? yes Unattached inode 1235 Connect to /lost+found? yes Inode 1235 ref count is 2, should be 1. Fix? yes Unattached inode 1236 Connect to /lost+found? yes Inode 1236 ref count is 2, should be 1. Fix? yes Unattached inode 1237 Connect to /lost+found? yes Inode 1237 ref count is 2, should be 1. Fix? yes Unattached inode 1238 Connect to /lost+found? yes Inode 1238 ref count is 2, should be 1. Fix? yes Unattached inode 1239 Connect to /lost+found? yes Inode 1239 ref count is 2, should be 1. Fix? yes Unattached inode 1240 Connect to /lost+found? yes Inode 1240 ref count is 2, should be 1. Fix? yes Unattached inode 1241 Connect to /lost+found? yes Inode 1241 ref count is 2, should be 1. Fix? yes Unattached inode 1242 Connect to /lost+found? yes Inode 1242 ref count is 2, should be 1. Fix? yes Unattached inode 1243 Connect to /lost+found? yes Inode 1243 ref count is 2, should be 1. Fix? yes Unattached inode 1244 Connect to /lost+found? yes Inode 1244 ref count is 2, should be 1. Fix? yes Unattached inode 1245 Connect to /lost+found? yes Inode 1245 ref count is 2, should be 1. Fix? yes Unattached inode 1246 Connect to /lost+found? yes Inode 1246 ref count is 2, should be 1. Fix? yes Unattached inode 1247 Connect to /lost+found? yes Inode 1247 ref count is 2, should be 1. Fix? yes Unattached inode 1248 Connect to /lost+found? yes Inode 1248 ref count is 2, should be 1. Fix? yes Unattached inode 1249 Connect to /lost+found? yes Inode 1249 ref count is 2, should be 1. Fix? yes Unattached inode 1250 Connect to /lost+found? yes Inode 1250 ref count is 2, should be 1. Fix? yes Unattached inode 1251 Connect to /lost+found? yes Inode 1251 ref count is 2, should be 1. Fix? yes Unattached inode 1252 Connect to /lost+found? yes Inode 1252 ref count is 2, should be 1. Fix? yes Unattached inode 1253 Connect to /lost+found? yes Inode 1253 ref count is 2, should be 1. Fix? yes Unattached inode 1254 Connect to /lost+found? yes Inode 1254 ref count is 2, should be 1. Fix? yes Unattached inode 1255 Connect to /lost+found? yes Inode 1255 ref count is 2, should be 1. Fix? yes Unattached inode 1256 Connect to /lost+found? yes Inode 1256 ref count is 2, should be 1. Fix? yes Unattached inode 1257 Connect to /lost+found? yes Inode 1257 ref count is 2, should be 1. Fix? yes Unattached inode 1258 Connect to /lost+found? yes Inode 1258 ref count is 2, should be 1. Fix? yes Unattached inode 1259 Connect to /lost+found? yes Inode 1259 ref count is 2, should be 1. Fix? yes Unattached inode 1260 Connect to /lost+found? yes Inode 1260 ref count is 2, should be 1. Fix? yes Unattached inode 1261 Connect to /lost+found? yes Inode 1261 ref count is 2, should be 1. Fix? yes Unattached inode 1262 Connect to /lost+found? yes Inode 1262 ref count is 2, should be 1. Fix? yes Unattached inode 1263 Connect to /lost+found? yes Inode 1263 ref count is 2, should be 1. Fix? yes Unattached inode 1264 Connect to /lost+found? yes Inode 1264 ref count is 2, should be 1. Fix? yes Unattached inode 1265 Connect to /lost+found? yes Inode 1265 ref count is 2, should be 1. Fix? yes Unattached inode 1266 Connect to /lost+found? yes Inode 1266 ref count is 2, should be 1. Fix? yes Unattached inode 1267 Connect to /lost+found? yes Inode 1267 ref count is 2, should be 1. Fix? yes Unattached inode 1268 Connect to /lost+found? yes Inode 1268 ref count is 2, should be 1. Fix? yes Pass 4: Memory used: 280k/0k (66k/215k), time: 0.09/ 0.06/ 0.02 Pass 4: I/O read: 1MB, write: 1MB, rate: 23.38MB/s Pass 5: Checking group summary information Pass 5: Memory used: 280k/0k (65k/216k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 1MB, rate: 312.60MB/s lustre-OST0000: ***** FILE SYSTEM WAS MODIFIED ***** 1469 inodes used (1.47%, out of 100000) 2 non-contiguous files (0.1%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 1463 20060 blocks used (20.06%, out of 100000) 0 bad blocks 1 large file 1254 regular files 205 directories 0 character device files pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 435 files Memory used: 280k/0k (64k/217k), time: 0.13/ 0.08/ 0.04 I/O read: 3MB, write: 1MB, rate: 31.89MB/s Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-OST0000 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Stopping clients: oleg152-client.virtnet /mnt/lustre (opts:) Stopping client oleg152-client.virtnet /mnt/lustre opts: Stopping clients: oleg152-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg152-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg152-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg152-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg152-server run e2fsck again after LFSCK e2fsck -d -v -t -t -f -y /dev/mapper/ost1_flakey -m8 oleg152-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg152-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 4) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 81 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 82 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 83 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 84 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 85 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 86 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 87 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 88 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 89 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 90 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 91 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 92 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 93 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 94 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 95 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 96 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 97 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 98 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 99 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 100 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 102 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 135 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] e2fsck_pass1_run:2564: increase inode 25043 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 25044 badness 0 to 2 for 10084 [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] Pass 1: Memory used: 280k/0k (153k/128k), time: 0.02/ 0.01/ 0.01 [Thread 0] Pass 1: I/O read: 5MB, write: 0MB, rate: 290.77MB/s [Thread 0] Scanned group range [0, 4), inodes 1470 Pass 2: Checking directory structure Pass 2: Memory used: 280k/0k (106k/175k), time: 0.01/ 0.00/ 0.01 Pass 2: I/O read: 1MB, write: 0MB, rate: 122.94MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 280k/0k (106k/175k), time: 0.04/ 0.01/ 0.02 Pass 3A: Memory used: 280k/0k (106k/175k), time: 0.00/ 0.00/ 0.00 Pass 3A: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 3: Memory used: 280k/0k (103k/178k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 1MB, write: 0MB, rate: 2590.67MB/s Pass 4: Checking reference counts Pass 4: Memory used: 280k/0k (66k/215k), time: 0.01/ 0.01/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 280k/0k (65k/216k), time: 0.01/ 0.01/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 124.72MB/s 1406 inodes used (1.41%, out of 100000) 2 non-contiguous files (0.1%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 Extent depth histogram: 1400 20060 blocks used (20.06%, out of 100000) 0 bad blocks 1 large file 1191 regular files 205 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 1396 files Memory used: 280k/0k (64k/217k), time: 0.06/ 0.03/ 0.02 I/O read: 2MB, write: 1MB, rate: 35.74MB/s PASS 14 (46s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 15: Dryrun mode OI scrub ============ 11:20:54 (1713280854) oleg152-server: oleg152-server.virtnet: executing set_hostid libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Using TIMEOUT=20 preparing... Tue Apr 16 11:21:40 EDT 2024 creating 20 files on mds1 striped dir -i0 -c1 -H crush /mnt/lustre/d15.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00831502 s, 126 MB/s creating 20 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d15.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00858077 s, 122 MB/s prepared Tue Apr 16 11:21:41 EDT 2024. stop mds1 stop mds2 file-level backup/restore on mds1:/dev/mapper/mds1_flakey backup data reformat new device Format mds1: /dev/mapper/mds1_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' file-level backup/restore on mds2:/dev/mapper/mds2_flakey backup data reformat new device Format mds2: /dev/mapper/mds2_flakey restore data remove recovery logs removed '/mnt/lustre-brpt/CATALOGS' starting MDTs with OI scrub disabled oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub Started LFSCK on the device lustre-MDT0000: scrub Started LFSCK on the device lustre-MDT0001: scrub PASS 15 (92s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 16: Initial OI scrub can rebuild crashed index objects ========================================================== 11:22:28 (1713280948) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions oleg152-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds1_flakey is already mounted on /mnt/lustre-mds1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds1_flakey on mds1 failed 17 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/mds2_flakey is already mounted on /mnt/lustre-mds2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 Start of /dev/mapper/mds2_flakey on mds2 failed 17 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost2_flakey is already mounted on /mnt/lustre-ost2 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0001-super.width=65536 Start of /dev/mapper/ost2_flakey on ost2 failed 17 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a817d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a817d000.idle_timeout=debug disable quota as required fail_loc=0x199 preparing... Tue Apr 16 11:22:50 EDT 2024 creating 0 files on mds1 striped dir -i0 -c1 -H fnv_1a_64 /mnt/lustre/d16.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00842009 s, 125 MB/s creating 0 files on mds2 striped dir -i1 -c1 -H crush2 /mnt/lustre/d16.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00833687 s, 126 MB/s prepared Tue Apr 16 11:22:52 EDT 2024. stop mds1 stop mds2 fail_loc=0 starting MDTs without disabling OI scrub oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre PASS 16 (51s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 17a: ENOSPC on OI insert shouldn't leak inodes ========================================================== 11:23:21 (1713281001) fail_loc=0x8000019d mkdir: cannot create directory '/mnt/lustre/d17a.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg152-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg152-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg152-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 5) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 19 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 20 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 21 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 22 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 23 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 25 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 26 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 27 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 28 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 47 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 56 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 61 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 70 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 71 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 72 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 73 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 186 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 187 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 188 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 189 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 191 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 192 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 193 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 194 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 195 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 196 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 197 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 198 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 199 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 200 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 201 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 202 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 203 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 218 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 219 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 262 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 263 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 264 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 265 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 266 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 267 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 268 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 269 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 270 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 271 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 272 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 273 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 274 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 275 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 276 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 277 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 278 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 279 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 280 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 281 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 282 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 283 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 284 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 285 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 286 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 287 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 288 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 289 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 290 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 291 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 292 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 293 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 294 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 295 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 296 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 297 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 298 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 299 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 300 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 301 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 302 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 303 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 304 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 305 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 306 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 307 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 308 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 309 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 310 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 311 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 312 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 313 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 316 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 318 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 319 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 320 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 322 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 325 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 328 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 329 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 332 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 333 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 334 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 336 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 340 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 342 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 343 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 344 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 346 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 347 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 348 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 349 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 350 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 351 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] Pass 1: Memory used: 296k/0k (169k/128k), time: 0.00/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 401.93MB/s [Thread 0] Scanned group range [0, 5), inodes 470 Pass 2: Checking directory structure Pass 2: Memory used: 296k/0k (125k/171k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 233.32MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 296k/0k (126k/171k), time: 0.02/ 0.01/ 0.01 Pass 3: Memory used: 296k/0k (124k/173k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 296k/0k (69k/228k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 296k/0k (69k/228k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 248.63MB/s 414 inodes used (0.26%, out of 160000) 1 non-contiguous file (0.2%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 44701 blocks used (44.70%, out of 100000) 0 bad blocks 1 large file 283 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 404 files Memory used: 296k/0k (68k/229k), time: 0.03/ 0.02/ 0.01 I/O read: 1MB, write: 0MB, rate: 32.27MB/s Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0000 PASS 17a (7s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 17b: ENOSPC on .. insertion shouldn't leak inodes ========================================================== 11:23:30 (1713281010) fail_loc=0x8000019e lfs mkdir: dirstripe error on '/mnt/lustre/d17b.sanity-scrub': No space left on device lfs setdirstripe: cannot create dir '/mnt/lustre/d17b.sanity-scrub': No space left on device Stopping /mnt/lustre-mds1 (opts:) on oleg152-server e2fsck -d -v -t -t -f -n /dev/mapper/mds1_flakey -m8 oleg152-server: e2fsck 1.46.2.wc5 (26-Mar-2022) oleg152-server: Use max possible thread num: 1 instead Pass 1: Checking inodes, blocks, and sizes [Thread 0] Scan group range [0, 5) [Thread 0] jumping to group 0 [Thread 0] e2fsck_pass1_run:2564: increase inode 19 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 20 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 21 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 22 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 23 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 24 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 25 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 26 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 27 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 28 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 47 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 56 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 61 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 70 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 71 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 72 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 73 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 186 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 187 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 188 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 189 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 190 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 191 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 192 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 193 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 194 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 195 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 196 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 197 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 198 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 199 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 200 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 201 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 202 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 203 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 218 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 219 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 262 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 263 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 264 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 265 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 266 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 267 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 268 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 269 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 270 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 271 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 272 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 273 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 274 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 275 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 276 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 277 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 278 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 279 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 280 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 281 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 282 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 283 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 284 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 285 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 286 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 287 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 288 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 289 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 290 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 291 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 292 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 293 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 294 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 295 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 296 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 297 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 298 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 299 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 300 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 301 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 302 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 303 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 304 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 305 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 306 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 307 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 308 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 309 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 310 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 311 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 312 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 313 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 316 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 318 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 319 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 320 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 322 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 325 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 328 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 329 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 332 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 333 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 334 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 336 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 340 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 342 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 343 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 344 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 346 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 347 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 348 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 349 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 350 badness 0 to 2 for 10084 [Thread 0] e2fsck_pass1_run:2564: increase inode 351 badness 0 to 2 for 10084 [Thread 0] group 1 finished [Thread 0] group 2 finished [Thread 0] group 3 finished [Thread 0] group 4 finished [Thread 0] group 5 finished [Thread 0] Pass 1: Memory used: 296k/0k (169k/128k), time: 0.00/ 0.00/ 0.00 [Thread 0] Pass 1: I/O read: 2MB, write: 0MB, rate: 446.13MB/s [Thread 0] Scanned group range [0, 5), inodes 470 Pass 2: Checking directory structure Pass 2: Memory used: 296k/0k (126k/171k), time: 0.00/ 0.00/ 0.00 Pass 2: I/O read: 1MB, write: 0MB, rate: 320.62MB/s Pass 3: Checking directory connectivity Peak memory: Memory used: 296k/0k (126k/171k), time: 0.02/ 0.01/ 0.00 Pass 3: Memory used: 296k/0k (124k/173k), time: 0.00/ 0.00/ 0.00 Pass 3: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 4: Checking reference counts Pass 4: Memory used: 296k/0k (69k/228k), time: 0.00/ 0.00/ 0.00 Pass 4: I/O read: 0MB, write: 0MB, rate: 0.00MB/s Pass 5: Checking group summary information Pass 5: Memory used: 296k/0k (69k/228k), time: 0.00/ 0.00/ 0.00 Pass 5: I/O read: 1MB, write: 0MB, rate: 254.78MB/s 414 inodes used (0.26%, out of 160000) 1 non-contiguous file (0.2%) 0 non-contiguous directories (0.0%) # of inodes with ind/dind/tind blocks: 0/0/0 44701 blocks used (44.70%, out of 100000) 0 bad blocks 1 large file 283 regular files 121 directories 0 character device files 0 block device files 0 fifos 0 links 0 symbolic links (0 fast symbolic links) 0 sockets ------------ 404 files Memory used: 296k/0k (68k/229k), time: 0.02/ 0.02/ 0.00 I/O read: 1MB, write: 0MB, rate: 40.43MB/s Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0000 PASS 17b (7s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 18: test mount -o resetoi to recreate OI files ========================================================== 11:23:39 (1713281019) preparing... Tue Apr 16 11:23:42 EDT 2024 creating 10 files on mds1 striped dir -i0 -c1 -H all_char /mnt/lustre/d18.sanity-scrub/mds1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00892264 s, 118 MB/s creating 10 files on mds2 striped dir -i1 -c1 -H crush /mnt/lustre/d18.sanity-scrub/mds2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00957248 s, 110 MB/s prepared Tue Apr 16 11:23:43 EDT 2024. stop mds1 stop mds2 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 [ 466.558244] Lustre: lustre-MDT0000: reset Object Index mappings [ 482.265739] Lustre: lustre-MDT0001: reset Object Index mappings [ 512.067307] Lustre: lustre-MDT0000: reset Object Index mappings [ 527.996527] Lustre: lustre-MDT0001: reset Object Index mappings [ 568.142339] Lustre: lustre-MDT0000: reset Object Index mappings [ 584.133164] Lustre: lustre-MDT0001: reset Object Index mappings [ 704.250490] Lustre: lustre-MDT0000: reset Object Index mappings [ 899.032413] Lustre: lustre-MDT0000: reset Object Index mappings [ 993.662533] Lustre: lustre-MDT0000: reset Object Index mappings [ 1124.411758] Lustre: lustre-MDT0001: reset Object Index mappings [ 1418.827370] Lustre: lustre-MDT0000: reset Object Index mappings [ 2018.708737] Lustre: lustre-MDT0000: reset Object Index mappings Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre PASS 18 (51s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 19: LFSCK can fix multiple linked files on OST ========================================================== 11:24:31 (1713281071) total: 64 open/close in 0.15 seconds: 429.67 ops/second stopall link /mnt/lustre-ost1/O/280000401/d2/291 to /mnt/lustre-ost1/O/280000401/d2/122 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started LFSCK on the device lustre-OST0000: scrub Stopping /mnt/lustre-ost1 (opts:) on oleg152-server File: '/mnt/lustre-ost1/O/280000401/d2/122' Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: fc02h/64514d Inode: 201 Links: 1 Access: (7666/-rwSrwSrwT) Uid: ( 0/ root) Gid: ( 0/ root) Access: 1969-12-31 19:00:00.000000000 -0500 Modify: 1969-12-31 19:00:00.000000000 -0500 Change: 2024-04-16 11:25:04.277000000 -0400 Birth: - oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 PASS 19 (169s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 20: Don't trigger OI scrub for irreparable oi repeatedly ========================================================== 11:27:21 (1713281241) Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0001 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 oleg152-server: mount.lustre: according to /etc/mtab /dev/mapper/ost1_flakey is already mounted on /mnt/lustre-ost1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 17 seq.cli-lustre-OST0000-super.width=65536 Start of /dev/mapper/ost1_flakey on ost1 failed 17 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-OST0001 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a4d6000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a4d6000.idle_timeout=debug disable quota as required fail_loc=0x193 Stopping /mnt/lustre-mds1 (opts:) on oleg152-server Starting mds1: -o localrecov -o user_xattr,noscrub /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0000 fail_loc=0x19f stat: cannot stat '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 1 seconds ago stat: cannot stat '/mnt/lustre/d20.sanity-scrub': Stale file handle OI scrub was triggerred 7 seconds ago PASS 20 (39s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-scrub test 21: don't hang MDS recovery when failed to get update log ========================================================== 11:28:01 (1713281281) /dev/mapper/mds1_flakey Stopping /mnt/lustre-mds1 (opts:) on oleg152-server Stopping /mnt/lustre-mds2 (opts:) on oleg152-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0000 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Started lustre-MDT0001 affected facets: mds2 oleg152-server: oleg152-server.virtnet: executing _wait_recovery_complete *.lustre-MDT0001.recovery_status 200 oleg152-server: *.lustre-MDT0001.recovery_status status: WAITING oleg152-server: Waiting 195 secs for *.lustre-MDT0001.recovery_status recovery done. status: WAITING oleg152-server: *.lustre-MDT0001.recovery_status status: COMPLETE PASS 21 (24s) debug_raw_pointers=0 debug_raw_pointers=0 debug=0 Stopping clients: oleg152-client.virtnet /mnt/lustre (opts:) Stopping client oleg152-client.virtnet /mnt/lustre opts: Stopping clients: oleg152-client.virtnet /mnt/lustre2 (opts:) Stopping /mnt/lustre-mds1 (opts:-f) on oleg152-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg152-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg152-server Stopping /mnt/lustre-ost2 (opts:-f) on oleg152-server unloading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing unload_modules_local modules unloaded. === sanity-scrub: start setup 11:29:05 (1713281345) === Stopping clients: oleg152-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg152-client.virtnet /mnt/lustre2 (opts:-f) pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 2 oleg152-server: oleg152-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions oleg152-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg152-server: quota/lquota options: 'hash_lqs_cur_bits=3' Formatting mgs, mds, osts Format mds1: /dev/vdc pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Format mds2: /dev/vdd pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Format ost1: /dev/vde pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Format ost2: /dev/vdf pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Checking servers environments Checking clients oleg152-client.virtnet environments Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg152-server' oleg152-server: oleg152-server.virtnet: executing load_modules_local oleg152-server: Loading modules from /home/green/git/lustre-release/lustre oleg152-server: detected 4 online CPUs by sysfs oleg152-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vdc Started lustre-MDT0000 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vdd Started lustre-MDT0001 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vde Started lustre-OST0000 pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Starting ost2: -o localrecov /dev/mapper/ost2_flakey /mnt/lustre-ost2 seq.cli-lustre-OST0001-super.width=65536 oleg152-server: oleg152-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg152-client: oleg152-server: ssh exited with exit code 1 Commit the device label on /dev/vdf Started lustre-OST0001 Starting client: oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Starting client oleg152-client.virtnet: -o user_xattr,flock oleg152-server@tcp:/lustre /mnt/lustre Started clients oleg152-client.virtnet: 192.168.201.152@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a83f3000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a83f3000.idle_timeout=debug setting jobstats to procname_uid Setting lustre.sys.jobid_var from disable to procname_uid Waiting 90s for 'procname_uid' Updated after 5s: want 'procname_uid' got 'procname_uid' disable quota as required osd-ldiskfs.track_declares_assert=1 === sanity-scrub: finish setup 11:30:08 (1713281408) === == sanity-scrub test complete, duration 2414 sec ========= 11:30:08 (1713281408) === sanity-scrub: start cleanup 11:30:08 (1713281408) === === sanity-scrub: finish cleanup 11:30:08 (1713281408) ===