== conf-sanity test 106: check osp llog processing when catalog is wrapped ========================================================== 08:50:32 (1713531032) Stopping clients: oleg224-client.virtnet /mnt/lustre (opts:-f) Stopping clients: oleg224-client.virtnet /mnt/lustre2 (opts:-f) oleg224-server: oleg224-server.virtnet: executing set_hostid Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory loading modules on: 'oleg224-server' oleg224-server: oleg224-server.virtnet: executing load_modules_local oleg224-server: Loading modules from /home/green/git/lustre-release/lustre oleg224-server: detected 4 online CPUs by sysfs oleg224-server: Force libcfs to create 2 CPU partitions Formatting mgs, mds, osts Format mds1: lustre-mdt1/mdt1 Format ost1: lustre-ost1/ost1 Format ost2: lustre-ost2/ost2 start mds service on oleg224-server Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg224-server: oleg224-server.virtnet: executing set_default_debug -1 all pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 Commit the device label on lustre-mdt1/mdt1 Started lustre-MDT0000 oleg224-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg224-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg224-server: oleg224-server.virtnet: executing set_default_debug -1 all pdsh@oleg224-client: oleg224-server: ssh exited with exit code 1 Commit the device label on lustre-ost1/ost1 Started lustre-OST0000 oleg224-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg224-client.virtnet: -o user_xattr,flock oleg224-server@tcp:/lustre /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 86842 329 86513 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 16134 326 15808 3% /mnt/lustre[OST:0] filesystem_summary: 16137 329 15808 3% /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff fail_loc=0x1312 fail_val=5 - open/close 4028 (time 1713531066.96 total 10.00 last 402.80) - open/close 7925 (time 1713531076.96 total 20.00 last 389.64) - open/close 10000 (time 1713531083.44 total 26.48 last 320.12) - open/close 12731 (time 1713531093.44 total 36.48 last 273.09) - open/close 15284 (time 1713531103.44 total 46.48 last 255.29) - open/close 17549 (time 1713531113.45 total 56.49 last 226.43) - open/close 19446 (time 1713531123.45 total 66.49 last 189.68) - open/close 20000 (time 1713531126.85 total 69.89 last 162.64) - open/close 22034 (time 1713531136.86 total 79.90 last 203.34) - open/close 23960 (time 1713531146.86 total 89.90 last 192.57) - open/close 25785 (time 1713531156.87 total 99.91 last 182.38) - open/close 27079 (time 1713531166.87 total 109.91 last 129.34) - open/close 28695 (time 1713531176.88 total 119.92 last 161.49) - open/close 30000 (time 1713531186.74 total 129.78 last 132.28) - open/close 31163 (time 1713531196.75 total 139.79 last 116.24) - open/close 32453 (time 1713531206.75 total 149.79 last 128.96) - open/close 33670 (time 1713531216.76 total 159.80 last 121.63) - open/close 34830 (time 1713531226.76 total 169.80 last 115.92) - open/close 35807 (time 1713531236.77 total 179.81 last 97.68) - open/close 36850 (time 1713531246.78 total 189.82 last 104.12) - open/close 37858 (time 1713531256.79 total 199.83 last 100.77) - open/close 39032 (time 1713531266.79 total 209.83 last 117.37) - open/close 40000 (time 1713531276.72 total 219.76 last 97.45) - open/close 41055 (time 1713531286.73 total 229.77 last 105.47) - open/close 42061 (time 1713531296.73 total 239.77 last 100.60) - open/close 43145 (time 1713531306.73 total 249.77 last 108.36) - open/close 44163 (time 1713531316.73 total 259.78 last 101.75) - open/close 45095 (time 1713531326.74 total 269.78 last 93.18) - open/close 45915 (time 1713531336.75 total 279.79 last 81.87) - open/close 46599 (time 1713531346.77 total 289.81 last 68.27) - open/close 47116 (time 1713531356.78 total 299.82 last 51.64) - open/close 47833 (time 1713531366.79 total 309.83 last 71.68) - open/close 48644 (time 1713531376.79 total 319.83 last 81.05) - open/close 49377 (time 1713531386.79 total 329.83 last 73.29) - open/close 50000 (time 1713531394.84 total 337.88 last 77.46) - open/close 50736 (time 1713531404.84 total 347.88 last 73.56) - open/close 51496 (time 1713531414.84 total 357.88 last 75.98) - open/close 52261 (time 1713531424.85 total 367.89 last 76.45) - open/close 52971 (time 1713531434.85 total 377.89 last 71.00) - open/close 53696 (time 1713531444.85 total 387.89 last 72.48) - open/close 54372 (time 1713531454.86 total 397.90 last 67.54) - open/close 55032 (time 1713531464.87 total 407.91 last 65.98) - open/close 55647 (time 1713531474.87 total 417.91 last 61.47) - open/close 56294 (time 1713531484.88 total 427.93 last 64.61) - open/close 56932 (time 1713531494.89 total 437.93 last 63.78) - open/close 57566 (time 1713531504.90 total 447.94 last 63.31) - open/close 58178 (time 1713531514.90 total 457.94 last 61.18) - open/close 58791 (time 1713531524.91 total 467.95 last 61.27) - open/close 59436 (time 1713531534.92 total 477.96 last 64.45) - open/close 60000 (time 1713531544.56 total 487.61 last 58.46) - open/close 60555 (time 1713531554.57 total 497.61 last 55.46) - open/close 61110 (time 1713531564.60 total 507.64 last 55.37) - open/close 61650 (time 1713531574.60 total 517.64 last 53.98) - open/close 62189 (time 1713531584.62 total 527.66 last 53.81) - open/close 62747 (time 1713531594.63 total 537.67 last 55.72) - open/close 63287 (time 1713531604.65 total 547.69 last 53.90) - open/close 63856 (time 1713531614.66 total 557.70 last 56.86) - open/close 64421 (time 1713531624.67 total 567.71 last 56.44) total: 64768 open/close in 573.92 seconds: 112.85 ops/second - /unlink 610 (time 1713531641.66 total 10.01 last 60.94) - /unlink 1198 (time 1713531651.67 total 20.02 last 58.75) - /unlink 1799 (time 1713531661.68 total 30.02 last 60.08) - /unlink 2382 (time 1713531671.69 total 40.04 last 58.22) - /unlink 2992 (time 1713531681.70 total 50.05 last 60.92) - /unlink 3580 (time 1713531691.71 total 60.06 last 58.75) - /unlink 4151 (time 1713531701.72 total 70.06 last 57.09) - /unlink 4714 (time 1713531711.73 total 80.07 last 56.23) - /unlink 5320 (time 1713531721.74 total 90.08 last 60.56) - /unlink 5888 (time 1713531731.74 total 100.08 last 56.79) - /unlink 6482 (time 1713531741.75 total 110.10 last 59.32) - /unlink 7077 (time 1713531751.75 total 120.10 last 59.49) - /unlink 7682 (time 1713531761.75 total 130.10 last 60.50) - /unlink 8312 (time 1713531771.77 total 140.11 last 62.90) - /unlink 8940 (time 1713531781.77 total 150.12 last 62.77) - /unlink 9588 (time 1713531791.78 total 160.13 last 64.73) - /unlink 10000 (time 1713531797.76 total 166.11 last 68.88) - /unlink 10628 (time 1713531807.77 total 176.11 last 62.78) - /unlink 11311 (time 1713531817.78 total 186.12 last 68.22) - /unlink 11954 (time 1713531827.79 total 196.13 last 64.25) - /unlink 12638 (time 1713531837.80 total 206.14 last 68.33) - /unlink 13330 (time 1713531847.80 total 216.15 last 69.16) - /unlink 13991 (time 1713531857.81 total 226.16 last 66.02) - /unlink 14682 (time 1713531867.82 total 236.16 last 69.08) - /unlink 15403 (time 1713531877.82 total 246.17 last 72.05) - /unlink 16095 (time 1713531887.83 total 256.18 last 69.15) - /unlink 16810 (time 1713531897.84 total 266.18 last 71.44) - /unlink 17581 (time 1713531907.84 total 276.19 last 77.06) - /unlink 18415 (time 1713531917.85 total 286.20 last 83.34) - /unlink 19129 (time 1713531927.86 total 296.21 last 71.31) - /unlink 19851 (time 1713531937.87 total 306.21 last 72.18) - /unlink 20597 (time 1713531947.87 total 316.21 last 74.59) - /unlink 21408 (time 1713531957.87 total 326.21 last 81.08) - /unlink 22243 (time 1713531967.87 total 336.22 last 83.49) - /unlink 23082 (time 1713531977.88 total 346.23 last 83.80) - /unlink 23918 (time 1713531987.90 total 356.24 last 83.49) - /unlink 24784 (time 1713531997.90 total 366.24 last 86.58) - /unlink 25685 (time 1713532007.90 total 376.24 last 90.09) - /unlink 26784 (time 1713532017.90 total 386.25 last 109.86) - /unlink 27859 (time 1713532027.90 total 396.25 last 107.48) - /unlink 28782 (time 1713532037.91 total 406.25 last 92.29) - /unlink 29761 (time 1713532047.91 total 416.26 last 97.83) - /unlink 30885 (time 1713532057.92 total 426.26 last 112.35) - /unlink 31838 (time 1713532067.92 total 436.27 last 95.27) - /unlink 32841 (time 1713532077.93 total 446.28 last 100.20) - /unlink 33901 (time 1713532087.94 total 456.29 last 105.90) - /unlink 35086 (time 1713532097.95 total 466.29 last 118.42) - /unlink 36261 (time 1713532107.95 total 476.30 last 117.44) - /unlink 37508 (time 1713532117.96 total 486.30 last 124.66) - /unlink 38731 (time 1713532127.96 total 496.30 last 122.25) - /unlink 39907 (time 1713532137.96 total 506.31 last 117.58) - /unlink 41281 (time 1713532147.97 total 516.31 last 137.32) - /unlink 42609 (time 1713532157.97 total 526.32 last 132.75) - /unlink 44220 (time 1713532167.97 total 536.32 last 161.08) - /unlink 45708 (time 1713532177.98 total 546.32 last 148.75) - /unlink 47295 (time 1713532187.98 total 556.32 last 158.65) - /unlink 48877 (time 1713532197.98 total 566.33 last 158.13) - /unlink 50000 (time 1713532203.67 total 572.01 last 197.54) - /unlink 52161 (time 1713532213.67 total 582.02 last 216.02) - /unlink 54093 (time 1713532223.67 total 592.02 last 193.20) - /unlink 56275 (time 1713532233.67 total 602.02 last 218.17) - /unlink 58716 (time 1713532243.67 total 612.02 last 244.07) - /unlink 60000 (time 1713532248.23 total 616.57 last 282.09) - /unlink 63938 (time 1713532258.23 total 626.57 last 393.70) total: 64768 /unlink in 628.59 seconds: 103.04 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 2356 (time 1713532286.95 total 10.00 last 235.50) - open/close 4722 (time 1713532296.95 total 20.01 last 236.53) - open/close 7042 (time 1713532306.95 total 30.01 last 231.95) - open/close 9105 (time 1713532316.96 total 40.01 last 206.21) - open/close 10000 (time 1713532322.18 total 45.23 last 171.44) - open/close 11781 (time 1713532332.18 total 55.24 last 178.04) - open/close 13726 (time 1713532342.18 total 65.24 last 194.49) - open/close 15214 (time 1713532352.18 total 75.24 last 148.76) - open/close 16589 (time 1713532362.19 total 85.24 last 137.47) - open/close 18067 (time 1713532372.19 total 95.25 last 147.77) - open/close 19402 (time 1713532382.19 total 105.25 last 133.42) - open/close 20000 (time 1713532386.80 total 109.85 last 129.95) - open/close 21316 (time 1713532396.80 total 119.86 last 131.53) - open/close 22517 (time 1713532406.80 total 129.86 last 120.08) - open/close 23721 (time 1713532416.81 total 139.87 last 120.32) - open/close 24886 (time 1713532426.81 total 149.87 last 116.43) - open/close 26021 (time 1713532436.82 total 159.87 last 113.48) - open/close 27100 (time 1713532446.82 total 169.88 last 107.83) - open/close 28170 (time 1713532456.83 total 179.89 last 106.96) - open/close 29507 (time 1713532466.84 total 189.90 last 133.57) - open/close 30000 (time 1713532471.33 total 194.39 last 109.70) - open/close 31261 (time 1713532481.34 total 204.39 last 126.05) - open/close 32244 (time 1713532491.34 total 214.40 last 98.25) - open/close 33265 (time 1713532501.35 total 224.40 last 102.04) - open/close 34347 (time 1713532511.35 total 234.41 last 108.15) - open/close 35375 (time 1713532521.36 total 244.42 last 102.71) - open/close 36368 (time 1713532531.37 total 254.42 last 99.24) - open/close 37242 (time 1713532541.37 total 264.43 last 87.34) - open/close 38200 (time 1713532551.38 total 274.43 last 95.76) - open/close 39064 (time 1713532561.38 total 284.44 last 86.34) - open/close 39964 (time 1713532571.39 total 294.45 last 89.94) - open/close 40794 (time 1713532581.40 total 304.46 last 82.93) - open/close 41660 (time 1713532591.41 total 314.47 last 86.51) - open/close 42398 (time 1713532601.42 total 324.48 last 73.73) - open/close 43280 (time 1713532611.42 total 334.48 last 88.17) - open/close 44037 (time 1713532621.42 total 344.48 last 75.70) - open/close 44766 (time 1713532631.43 total 354.49 last 72.81) - open/close 45517 (time 1713532641.45 total 364.50 last 75.01) - open/close 46215 (time 1713532651.45 total 374.51 last 69.75) - open/close 46908 (time 1713532661.46 total 384.52 last 69.25) - open/close 47559 (time 1713532671.48 total 394.53 last 65.00) - open/close 48293 (time 1713532681.48 total 404.54 last 73.35) - open/close 49080 (time 1713532691.50 total 414.56 last 78.58) - open/close 49936 (time 1713532701.51 total 424.56 last 85.53) - open/close 50574 (time 1713532711.51 total 434.56 last 63.79) - open/close 51229 (time 1713532721.52 total 444.57 last 65.44) - open/close 51901 (time 1713532731.52 total 454.58 last 67.17) - open/close 52515 (time 1713532741.53 total 464.59 last 61.35) - open/close 53104 (time 1713532751.55 total 474.60 last 58.81) - open/close 53700 (time 1713532761.55 total 484.60 last 59.60) - open/close 54344 (time 1713532771.55 total 494.61 last 64.36) - open/close 54975 (time 1713532781.56 total 504.62 last 63.04) - open/close 55586 (time 1713532791.57 total 514.62 last 61.06) - open/close 56205 (time 1713532801.58 total 524.64 last 61.83) - open/close 56784 (time 1713532811.59 total 534.65 last 57.85) - open/close 57329 (time 1713532821.59 total 544.65 last 54.46) - open/close 57937 (time 1713532831.60 total 554.66 last 60.77) - open/close 58473 (time 1713532841.60 total 564.66 last 53.59) - open/close 59124 (time 1713532851.60 total 574.66 last 65.09) - open/close 59728 (time 1713532861.62 total 584.68 last 60.26) - open/close 60000 (time 1713532866.84 total 589.90 last 52.12) - open/close 60554 (time 1713532876.85 total 599.91 last 55.35) - open/close 61094 (time 1713532886.86 total 609.92 last 53.96) - open/close 61622 (time 1713532896.87 total 619.93 last 52.75) - open/close 62168 (time 1713532906.87 total 629.93 last 54.58) - open/close 62812 (time 1713532916.88 total 639.93 last 64.37) - open/close 63383 (time 1713532926.88 total 649.94 last 57.08) - open/close 63872 (time 1713532936.88 total 659.94 last 48.89) - open/close 64348 (time 1713532946.90 total 669.95 last 47.53) total: 64768 open/close in 678.18 seconds: 95.50 ops/second - /unlink 556 (time 1713532966.20 total 10.00 last 55.60) - /unlink 1122 (time 1713532976.21 total 20.02 last 56.50) - /unlink 1705 (time 1713532986.23 total 30.03 last 58.21) - /unlink 2335 (time 1713532996.24 total 40.04 last 62.95) - /unlink 2953 (time 1713533006.24 total 50.05 last 61.75) - /unlink 3606 (time 1713533016.25 total 60.05 last 65.29) - /unlink 4188 (time 1713533026.27 total 70.07 last 58.09) - /unlink 4770 (time 1713533036.27 total 80.08 last 58.15) - /unlink 5391 (time 1713533046.29 total 90.09 last 62.01) - /unlink 6016 (time 1713533056.29 total 100.10 last 62.46) - /unlink 6709 (time 1713533066.30 total 110.11 last 69.24) - /unlink 7374 (time 1713533076.33 total 120.14 last 66.32) - /unlink 8239 (time 1713533086.34 total 130.14 last 86.42) - /unlink 8991 (time 1713533096.35 total 140.15 last 75.16) - /unlink 9691 (time 1713533106.35 total 150.16 last 69.94) - /unlink 10000 (time 1713533110.58 total 154.38 last 73.12) - /unlink 10677 (time 1713533120.59 total 164.39 last 67.66) - /unlink 11372 (time 1713533130.59 total 174.39 last 69.48) - /unlink 12063 (time 1713533140.59 total 184.39 last 69.10) - /unlink 12734 (time 1713533150.60 total 194.40 last 67.06) - /unlink 13429 (time 1713533160.61 total 204.41 last 69.42) - /unlink 14141 (time 1713533170.61 total 214.42 last 71.18) - /unlink 14827 (time 1713533180.62 total 224.43 last 68.51) - /unlink 15519 (time 1713533190.64 total 234.44 last 69.11) - /unlink 16288 (time 1713533200.65 total 244.45 last 76.80) - /unlink 17029 (time 1713533210.66 total 254.46 last 74.03) - /unlink 17766 (time 1713533220.66 total 264.47 last 73.68) - /unlink 18470 (time 1713533230.68 total 274.49 last 70.25) - /unlink 19206 (time 1713533240.69 total 284.50 last 73.54) - /unlink 19924 (time 1713533250.71 total 294.51 last 71.70) - /unlink 20672 (time 1713533260.71 total 304.51 last 74.78) - /unlink 21478 (time 1713533270.71 total 314.51 last 80.59) - /unlink 22238 (time 1713533280.72 total 324.52 last 75.94) - /unlink 23022 (time 1713533290.72 total 334.53 last 78.35) - /unlink 23827 (time 1713533300.72 total 344.53 last 80.49) - /unlink 24702 (time 1713533310.73 total 354.54 last 87.43) - /unlink 25556 (time 1713533320.74 total 364.54 last 85.33) - /unlink 26492 (time 1713533330.75 total 374.55 last 93.54) - /unlink 27433 (time 1713533340.75 total 384.56 last 94.05) - /unlink 28407 (time 1713533350.76 total 394.56 last 97.36) - /unlink 29316 (time 1713533360.76 total 404.57 last 90.85) - /unlink 30000 (time 1713533367.50 total 411.30 last 101.55) - /unlink 31032 (time 1713533377.50 total 421.30 last 103.18) - /unlink 32067 (time 1713533387.51 total 431.31 last 103.43) - /unlink 33154 (time 1713533397.51 total 441.31 last 108.68) - /unlink 34208 (time 1713533407.51 total 451.32 last 105.36) - /unlink 35301 (time 1713533417.51 total 461.32 last 109.28) - /unlink 36363 (time 1713533427.52 total 471.33 last 106.11) - /unlink 37464 (time 1713533437.53 total 481.33 last 110.00) - /unlink 38638 (time 1713533447.53 total 491.34 last 117.36) - /unlink 39773 (time 1713533457.54 total 501.35 last 113.39) - /unlink 40964 (time 1713533467.55 total 511.36 last 119.02) - /unlink 42204 (time 1713533477.56 total 521.36 last 123.92) - /unlink 43477 (time 1713533487.56 total 531.37 last 127.20) - /unlink 44791 (time 1713533497.57 total 541.37 last 131.34) - /unlink 46215 (time 1713533507.57 total 551.38 last 142.36) - /unlink 47650 (time 1713533517.58 total 561.38 last 143.45) - /unlink 49164 (time 1713533527.58 total 571.38 last 151.39) - /unlink 50000 (time 1713533532.10 total 575.91 last 184.61) - /unlink 51806 (time 1713533542.11 total 585.91 last 180.55) - /unlink 53838 (time 1713533552.11 total 595.92 last 203.13) - /unlink 56011 (time 1713533562.11 total 605.92 last 217.28) - /unlink 58428 (time 1713533572.11 total 615.92 last 241.65) - /unlink 60000 (time 1713533577.76 total 621.56 last 278.63) - /unlink 63297 (time 1713533587.76 total 631.56 last 329.66) total: 64768 /unlink in 634.97 seconds: 102.00 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 2443 (time 1713533619.85 total 10.00 last 244.24) - open/close 5709 (time 1713533629.85 total 20.00 last 326.54) - open/close 7652 (time 1713533639.85 total 30.01 last 194.21) - open/close 9450 (time 1713533649.86 total 40.01 last 179.74) - open/close 10000 (time 1713533653.08 total 43.24 last 170.34) - open/close 11660 (time 1713533663.09 total 53.25 last 165.89) - open/close 13160 (time 1713533673.10 total 63.25 last 149.94) - open/close 14600 (time 1713533683.10 total 73.26 last 143.89) - open/close 15950 (time 1713533693.10 total 83.26 last 134.98) - open/close 17244 (time 1713533703.11 total 93.27 last 129.34) - open/close 18556 (time 1713533713.12 total 103.27 last 131.11) - open/close 19744 (time 1713533723.12 total 113.28 last 118.75) - open/close 20000 (time 1713533725.36 total 115.51 last 114.44) - open/close 21215 (time 1713533735.36 total 125.51 last 121.49) - open/close 22361 (time 1713533745.37 total 135.52 last 114.49) - open/close 23402 (time 1713533755.37 total 145.53 last 104.07) - open/close 24431 (time 1713533765.38 total 155.53 last 102.80) - open/close 25553 (time 1713533775.39 total 165.54 last 112.11) - open/close 26626 (time 1713533785.39 total 175.55 last 107.24) - open/close 27560 (time 1713533795.40 total 185.56 last 93.33) - open/close 28469 (time 1713533805.40 total 195.56 last 90.88) - open/close 29417 (time 1713533815.41 total 205.57 last 94.71) - open/close 30000 (time 1713533822.39 total 212.54 last 83.57) - open/close 30966 (time 1713533832.39 total 222.55 last 96.57) - open/close 31886 (time 1713533842.39 total 232.55 last 91.99) - open/close 32878 (time 1713533852.39 total 242.55 last 99.19) - open/close 33839 (time 1713533862.40 total 252.55 last 96.05) - open/close 34793 (time 1713533872.40 total 262.56 last 95.37) - open/close 35656 (time 1713533882.40 total 272.56 last 86.30) - open/close 36502 (time 1713533892.41 total 282.57 last 84.51) - open/close 37390 (time 1713533902.42 total 292.57 last 88.74) - open/close 38219 (time 1713533912.43 total 302.58 last 82.83) - open/close 39049 (time 1713533922.43 total 312.59 last 82.98) - open/close 39778 (time 1713533932.44 total 322.60 last 72.81) - open/close 40000 (time 1713533935.62 total 325.78 last 69.83) - open/close 40776 (time 1713533945.62 total 335.78 last 77.60) - open/close 41492 (time 1713533955.63 total 345.78 last 71.56) - open/close 42190 (time 1713533965.64 total 355.79 last 69.73) - open/close 42924 (time 1713533975.65 total 365.81 last 73.31) - open/close 43634 (time 1713533985.66 total 375.82 last 70.93) - open/close 44307 (time 1713533995.67 total 385.83 last 67.20) - open/close 44977 (time 1713534005.68 total 395.84 last 66.95) - open/close 45680 (time 1713534015.69 total 405.85 last 70.21) - open/close 46490 (time 1713534025.70 total 415.86 last 80.96) - open/close 47196 (time 1713534035.70 total 425.86 last 70.56) - open/close 47867 (time 1713534045.71 total 435.86 last 67.07) - open/close 48527 (time 1713534055.72 total 445.88 last 65.92) - open/close 49266 (time 1713534065.72 total 455.88 last 73.88) - open/close 49862 (time 1713534075.73 total 465.88 last 59.58) - open/close 50000 (time 1713534078.23 total 468.39 last 55.05) - open/close 50599 (time 1713534088.25 total 478.40 last 59.82) - open/close 51270 (time 1713534098.25 total 488.40 last 67.09) - open/close 51973 (time 1713534108.25 total 498.41 last 70.27) - open/close 52571 (time 1713534118.25 total 508.41 last 59.78) - open/close 53107 (time 1713534128.26 total 518.42 last 53.55) - open/close 53748 (time 1713534138.28 total 528.43 last 64.01) - open/close 54360 (time 1713534148.28 total 538.43 last 61.19) - open/close 54974 (time 1713534158.28 total 548.44 last 61.36) - open/close 55579 (time 1713534168.29 total 558.45 last 60.45) - open/close 56191 (time 1713534178.30 total 568.46 last 61.13) - open/close 56747 (time 1713534188.31 total 578.46 last 55.59) - open/close 57320 (time 1713534198.31 total 588.47 last 57.25) - open/close 57850 (time 1713534208.33 total 598.49 last 52.92) - open/close 58430 (time 1713534218.34 total 608.50 last 57.92) - open/close 58997 (time 1713534228.36 total 618.51 last 56.61) - open/close 59560 (time 1713534238.36 total 628.52 last 56.27) - open/close 60000 (time 1713534245.68 total 635.83 last 60.16) - open/close 60522 (time 1713534255.68 total 645.84 last 52.17) - open/close 61127 (time 1713534265.69 total 655.84 last 60.48) - open/close 61798 (time 1713534275.69 total 665.85 last 67.06) - open/close 62424 (time 1713534285.69 total 675.85 last 62.60) - open/close 63035 (time 1713534295.70 total 685.86 last 61.04) - open/close 63661 (time 1713534305.72 total 695.87 last 62.51) - open/close 64188 (time 1713534315.73 total 705.88 last 52.65) - open/close 64696 (time 1713534325.74 total 715.89 last 50.76) total: 64768 open/close in 716.77 seconds: 90.36 ops/second - /unlink 715 (time 1713534337.70 total 10.00 last 71.47) - /unlink 1367 (time 1713534347.72 total 20.02 last 65.07) - /unlink 1933 (time 1713534357.73 total 30.02 last 56.60) - /unlink 2466 (time 1713534367.75 total 40.05 last 53.18) - /unlink 3010 (time 1713534377.75 total 50.05 last 54.39) - /unlink 3598 (time 1713534387.76 total 60.06 last 58.70) - /unlink 4242 (time 1713534397.77 total 70.07 last 64.39) - /unlink 4919 (time 1713534407.77 total 80.07 last 67.64) - /unlink 5622 (time 1713534417.78 total 90.08 last 70.23) - /unlink 6318 (time 1713534427.79 total 100.09 last 69.53) - /unlink 7084 (time 1713534437.80 total 110.10 last 76.55) - /unlink 7773 (time 1713534447.81 total 120.11 last 68.82) - /unlink 8514 (time 1713534457.82 total 130.12 last 74.02) - /unlink 9315 (time 1713534467.83 total 140.13 last 80.06) - /unlink 10000 (time 1713534476.54 total 148.84 last 78.62) - /unlink 10828 (time 1713534486.55 total 158.85 last 82.74) - /unlink 11693 (time 1713534496.55 total 168.85 last 86.48) - /unlink 12504 (time 1713534506.55 total 178.85 last 81.07) - /unlink 13369 (time 1713534516.56 total 188.85 last 86.50) - /unlink 14302 (time 1713534526.56 total 198.86 last 93.25) - /unlink 15264 (time 1713534536.56 total 208.86 last 96.18) - /unlink 16233 (time 1713534546.57 total 218.87 last 96.82) - /unlink 17214 (time 1713534556.57 total 228.87 last 98.07) - /unlink 18199 (time 1713534566.58 total 238.88 last 98.47) - /unlink 19310 (time 1713534576.58 total 248.88 last 111.00) - /unlink 20000 (time 1713534583.11 total 255.41 last 105.76) - /unlink 21118 (time 1713534593.11 total 265.41 last 111.77) - /unlink 22286 (time 1713534603.12 total 275.42 last 116.75) - /unlink 23211 (time 1713534613.13 total 285.43 last 92.41) - /unlink 24103 (time 1713534623.13 total 295.43 last 89.15) - /unlink 25552 (time 1713534633.13 total 305.43 last 144.85) - /unlink 26727 (time 1713534643.14 total 315.44 last 117.47) - /unlink 27652 (time 1713534653.14 total 325.44 last 92.44) - /unlink 28594 (time 1713534663.15 total 335.45 last 94.10) - /unlink 29524 (time 1713534673.16 total 345.46 last 92.94) - /unlink 30000 (time 1713534678.03 total 350.33 last 97.67) - /unlink 30968 (time 1713534688.04 total 360.34 last 96.78) - /unlink 32228 (time 1713534698.04 total 370.34 last 125.91) - /unlink 33258 (time 1713534708.05 total 380.35 last 102.91) - /unlink 34619 (time 1713534718.06 total 390.36 last 135.99) - /unlink 35807 (time 1713534728.06 total 400.36 last 118.75) - /unlink 36907 (time 1713534738.07 total 410.37 last 109.94) - /unlink 38061 (time 1713534748.08 total 420.38 last 115.31) - /unlink 39373 (time 1713534758.08 total 430.38 last 131.15) - /unlink 40000 (time 1713534763.09 total 435.39 last 125.14) - /unlink 41307 (time 1713534773.09 total 445.39 last 130.67) - /unlink 42621 (time 1713534783.10 total 455.40 last 131.31) - /unlink 44169 (time 1713534793.11 total 465.41 last 154.69) - /unlink 45706 (time 1713534803.11 total 475.41 last 153.65) - /unlink 47401 (time 1713534813.11 total 485.41 last 169.47) - /unlink 49367 (time 1713534823.12 total 495.41 last 196.57) - /unlink 50000 (time 1713534826.92 total 499.22 last 166.51) - /unlink 51846 (time 1713534836.92 total 509.22 last 184.50) - /unlink 53794 (time 1713534846.92 total 519.22 last 194.79) - /unlink 55918 (time 1713534856.93 total 529.23 last 212.32) - /unlink 58349 (time 1713534866.93 total 539.23 last 243.07) - /unlink 60000 (time 1713534872.96 total 545.26 last 273.80) - /unlink 63273 (time 1713534882.96 total 555.26 last 327.29) total: 64768 /unlink in 559.10 seconds: 115.84 ops/second sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete - open/close 2336 (time 1713534911.17 total 10.00 last 233.55) - open/close 4385 (time 1713534921.17 total 20.00 last 204.90) - open/close 6279 (time 1713534931.18 total 30.01 last 189.31) - open/close 8137 (time 1713534941.18 total 40.01 last 185.80) - open/close 9851 (time 1713534951.18 total 50.01 last 171.39) - open/close 11553 (time 1713534961.18 total 60.01 last 170.19) - open/close 13297 (time 1713534971.18 total 70.01 last 174.31) - open/close 14932 (time 1713534981.19 total 80.02 last 163.47) - open/close 16514 (time 1713534991.19 total 90.02 last 158.10) - open/close 18043 (time 1713535001.19 total 100.02 last 152.88) - open/close 19482 (time 1713535011.20 total 110.03 last 143.84) - open/close 20000 (time 1713535013.97 total 112.80 last 186.78) - open/close 21379 (time 1713535023.97 total 122.80 last 137.87) - open/close 22705 (time 1713535033.98 total 132.81 last 132.56) - open/close 24011 (time 1713535043.98 total 142.81 last 130.57) - open/close 25308 (time 1713535053.98 total 152.81 last 129.69) - open/close 26567 (time 1713535063.99 total 162.82 last 125.82) - open/close 27822 (time 1713535073.99 total 172.82 last 125.45) - open/close 29106 (time 1713535084.00 total 182.83 last 128.31) - open/close 30000 (time 1713535091.77 total 190.60 last 114.98) - open/close 31232 (time 1713535101.78 total 200.61 last 123.09) - open/close 32300 (time 1713535111.79 total 210.62 last 106.72) - open/close 34444 (time 1713535121.79 total 220.62 last 214.30) - open/close 36496 (time 1713535131.79 total 230.62 last 205.18) - open/close 38431 (time 1713535141.80 total 240.63 last 193.42) - open/close 40000 (time 1713535150.26 total 249.09 last 185.49) - open/close 41806 (time 1713535160.26 total 259.09 last 180.55) - open/close 42807 (time 1713535170.27 total 269.10 last 99.96) - open/close 43714 (time 1713535180.28 total 279.10 last 90.69) - open/close 44732 (time 1713535190.28 total 289.11 last 101.78) - open/close 45788 (time 1713535200.29 total 299.12 last 105.51) - open/close 46587 (time 1713535210.29 total 309.12 last 79.86) - open/close 47455 (time 1713535220.30 total 319.12 last 86.76) - open/close 48333 (time 1713535230.31 total 329.14 last 87.64) - open/close 49062 (time 1713535240.32 total 339.15 last 72.84) - open/close 49814 (time 1713535250.33 total 349.16 last 75.14) - open/close 50000 (time 1713535252.66 total 351.49 last 79.69) - open/close 50742 (time 1713535262.67 total 361.50 last 74.12) - open/close 51456 (time 1713535272.69 total 371.52 last 71.32) - open/close 52319 (time 1713535282.69 total 381.52 last 86.28) - open/close 53041 (time 1713535292.69 total 391.52 last 72.18) - open/close 53819 (time 1713535302.70 total 401.53 last 77.75) - open/close 54700 (time 1713535312.71 total 411.54 last 88.01) - open/close 55488 (time 1713535322.72 total 421.55 last 78.70) - open/close 56164 (time 1713535332.74 total 431.57 last 67.49) - open/close 56803 (time 1713535342.74 total 441.57 last 63.85) - open/close 57469 (time 1713535352.75 total 451.58 last 66.56) - open/close 58090 (time 1713535362.76 total 461.59 last 62.04) - open/close 58785 (time 1713535372.77 total 471.59 last 69.46) - open/close 59403 (time 1713535382.77 total 481.60 last 61.78) - open/close 60000 (time 1713535392.04 total 490.87 last 64.37) - open/close 60603 (time 1713535402.05 total 500.88 last 60.27) - open/close 61239 (time 1713535412.05 total 510.88 last 63.58) - open/close 61825 (time 1713535422.05 total 520.88 last 58.59) - open/close 62417 (time 1713535432.06 total 530.89 last 59.16) - open/close 63000 (time 1713535442.06 total 540.89 last 58.28) - open/close 63589 (time 1713535452.06 total 550.89 last 58.90) - open/close 64220 (time 1713535462.07 total 560.89 last 63.08) total: 64768 open/close in 569.87 seconds: 113.65 ops/second