-----============= acceptance-small: sanity-benchmark ============----- Tue Apr 16 14:58:25 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 14:58:29 (1713293909) === oleg435-client.virtnet: executing check_config_client /mnt/lustre oleg435-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg435-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8801373ab800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8801373ab800.idle_timeout=debug disable quota as required oleg435-server: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 14:58:37 (1713293917) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 14:58:38 (1713293918) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6933] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg435-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg435-client.virtnet at Tue Apr 16 14:58:39 EDT 2024 waiting for dbench pid 8944 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 139 121.06 MB/sec warmup 1 sec latency 133.803 ms 20 279 104.15 MB/sec warmup 2 sec latency 70.065 ms 20 436 102.29 MB/sec warmup 3 sec latency 75.281 ms 20 606 102.83 MB/sec warmup 4 sec latency 81.519 ms 20 700 84.76 MB/sec warmup 5 sec latency 362.112 ms 20 778 71.23 MB/sec warmup 6 sec latency 152.909 ms 20 871 61.83 MB/sec warmup 7 sec latency 178.917 ms 20 1023 56.65 MB/sec warmup 8 sec latency 136.818 ms 20 1257 51.32 MB/sec warmup 9 sec latency 30.032 ms 20 1516 52.12 MB/sec warmup 10 sec latency 151.701 ms 20 1719 47.70 MB/sec warmup 11 sec latency 90.861 ms 20 1926 44.03 MB/sec warmup 12 sec latency 90.794 ms 20 2196 41.32 MB/sec warmup 13 sec latency 81.437 ms 20 2406 40.06 MB/sec warmup 14 sec latency 119.345 ms 20 2666 40.19 MB/sec warmup 15 sec latency 139.636 ms 20 3015 42.06 MB/sec warmup 16 sec latency 144.908 ms 20 3337 41.85 MB/sec warmup 17 sec latency 147.993 ms 20 3605 42.86 MB/sec warmup 18 sec latency 119.374 ms 20 3799 41.76 MB/sec warmup 19 sec latency 39.095 ms 20 3947 40.02 MB/sec warmup 20 sec latency 33.756 ms 20 4066 38.17 MB/sec warmup 21 sec latency 206.483 ms 20 4227 36.57 MB/sec warmup 22 sec latency 206.130 ms 20 4311 35.17 MB/sec warmup 23 sec latency 179.909 ms 20 4564 9.72 MB/sec execute 1 sec latency 144.246 ms 20 4739 17.20 MB/sec execute 2 sec latency 165.503 ms 20 4952 23.84 MB/sec execute 3 sec latency 114.500 ms 20 5129 22.68 MB/sec execute 4 sec latency 105.097 ms 20 5264 18.61 MB/sec execute 5 sec latency 109.769 ms 20 5400 15.90 MB/sec execute 6 sec latency 90.108 ms 20 5588 14.17 MB/sec execute 7 sec latency 82.406 ms 20 5781 13.51 MB/sec execute 8 sec latency 99.841 ms 20 5958 14.45 MB/sec execute 9 sec latency 176.581 ms 20 6103 15.44 MB/sec execute 10 sec latency 178.296 ms 20 6338 18.32 MB/sec execute 11 sec latency 199.139 ms 20 6578 20.15 MB/sec execute 12 sec latency 173.142 ms 20 6810 20.71 MB/sec execute 13 sec latency 171.772 ms 20 7021 21.80 MB/sec execute 14 sec latency 228.852 ms 20 7210 22.94 MB/sec execute 15 sec latency 130.554 ms 20 7355 22.66 MB/sec execute 16 sec latency 42.661 ms 20 7475 21.67 MB/sec execute 17 sec latency 38.235 ms 20 7579 20.56 MB/sec execute 18 sec latency 203.634 ms 20 7690 19.54 MB/sec execute 19 sec latency 128.491 ms 20 7837 18.80 MB/sec execute 20 sec latency 159.347 ms 20 7933 18.14 MB/sec execute 21 sec latency 155.474 ms 20 8051 17.68 MB/sec execute 22 sec latency 153.966 ms 20 8184 17.62 MB/sec execute 23 sec latency 159.951 ms 20 8363 17.77 MB/sec execute 24 sec latency 155.893 ms 20 8560 18.64 MB/sec execute 25 sec latency 98.506 ms 20 8712 18.22 MB/sec execute 26 sec latency 93.405 ms 20 8870 17.65 MB/sec execute 27 sec latency 79.562 ms 20 9041 17.13 MB/sec execute 28 sec latency 74.719 ms 20 9233 16.80 MB/sec execute 29 sec latency 89.568 ms 20 9433 16.76 MB/sec execute 30 sec latency 93.670 ms 20 9649 17.31 MB/sec execute 31 sec latency 136.824 ms 20 9957 18.56 MB/sec execute 32 sec latency 117.573 ms 20 10257 19.49 MB/sec execute 33 sec latency 130.764 ms 20 10548 20.09 MB/sec execute 34 sec latency 122.759 ms 20 10793 20.85 MB/sec execute 35 sec latency 83.249 ms 20 10957 20.76 MB/sec execute 36 sec latency 37.414 ms 20 11097 20.34 MB/sec execute 37 sec latency 63.070 ms 20 11203 19.83 MB/sec execute 38 sec latency 199.593 ms 20 11359 19.43 MB/sec execute 39 sec latency 137.212 ms 20 11431 19.03 MB/sec execute 40 sec latency 184.339 ms 20 11508 18.67 MB/sec execute 41 sec latency 177.590 ms 20 11615 18.39 MB/sec execute 42 sec latency 153.227 ms 20 11744 18.34 MB/sec execute 43 sec latency 141.822 ms 20 11887 18.37 MB/sec execute 44 sec latency 190.151 ms 20 12018 18.20 MB/sec execute 45 sec latency 107.471 ms 20 12181 18.58 MB/sec execute 46 sec latency 122.107 ms 20 12301 18.23 MB/sec execute 47 sec latency 113.506 ms 20 12430 17.89 MB/sec execute 48 sec latency 130.691 ms 20 12544 17.58 MB/sec execute 49 sec latency 98.307 ms 20 12655 17.27 MB/sec execute 50 sec latency 113.474 ms 20 12801 17.09 MB/sec execute 51 sec latency 124.455 ms 20 12943 16.94 MB/sec execute 52 sec latency 126.612 ms 20 13125 17.18 MB/sec execute 53 sec latency 169.165 ms 20 13263 17.25 MB/sec execute 54 sec latency 236.230 ms 20 13469 17.52 MB/sec execute 55 sec latency 166.377 ms 20 13717 18.08 MB/sec execute 56 sec latency 209.459 ms 20 13914 18.26 MB/sec execute 57 sec latency 155.089 ms 20 14132 18.45 MB/sec execute 58 sec latency 175.282 ms 20 14308 18.84 MB/sec execute 59 sec latency 134.570 ms 20 14442 18.71 MB/sec execute 60 sec latency 50.135 ms 20 14548 18.54 MB/sec execute 61 sec latency 47.802 ms 20 14649 18.30 MB/sec execute 62 sec latency 105.135 ms 20 14716 18.02 MB/sec execute 63 sec latency 252.528 ms 20 14795 17.76 MB/sec execute 64 sec latency 188.834 ms 20 14904 17.53 MB/sec execute 65 sec latency 209.862 ms 20 14970 17.32 MB/sec execute 66 sec latency 200.554 ms 20 15046 17.12 MB/sec execute 67 sec latency 180.413 ms 20 15144 16.98 MB/sec execute 68 sec latency 178.511 ms 20 15248 16.87 MB/sec execute 69 sec latency 151.626 ms 20 15371 16.91 MB/sec execute 70 sec latency 159.554 ms 20 15511 16.91 MB/sec execute 71 sec latency 105.020 ms 20 15630 16.93 MB/sec execute 72 sec latency 140.217 ms 20 15738 16.95 MB/sec execute 73 sec latency 145.262 ms 20 15810 16.74 MB/sec execute 74 sec latency 261.182 ms 20 15902 16.53 MB/sec execute 75 sec latency 144.651 ms 20 16000 16.34 MB/sec execute 76 sec latency 194.308 ms 20 16109 16.16 MB/sec execute 77 sec latency 100.029 ms 20 16219 15.99 MB/sec execute 78 sec latency 106.742 ms 20 16348 15.89 MB/sec execute 79 sec latency 143.353 ms 20 16488 15.83 MB/sec execute 80 sec latency 141.180 ms 20 16668 15.94 MB/sec execute 81 sec latency 131.662 ms 20 16856 16.13 MB/sec execute 82 sec latency 142.514 ms 20 17104 16.47 MB/sec execute 83 sec latency 129.881 ms 20 17386 16.88 MB/sec execute 84 sec latency 144.537 ms 20 17656 17.07 MB/sec execute 85 sec latency 173.205 ms 20 17888 17.41 MB/sec execute 86 sec latency 95.676 ms 20 18044 17.35 MB/sec execute 87 sec latency 38.273 ms 20 18152 17.21 MB/sec execute 88 sec latency 175.074 ms 20 18266 17.06 MB/sec execute 89 sec latency 192.576 ms 20 18377 16.89 MB/sec execute 90 sec latency 149.631 ms 20 18490 16.75 MB/sec execute 91 sec latency 184.410 ms 20 18574 16.62 MB/sec execute 92 sec latency 153.156 ms 20 18691 16.56 MB/sec execute 93 sec latency 142.054 ms 20 18803 16.49 MB/sec execute 94 sec latency 176.911 ms 20 18966 16.56 MB/sec execute 95 sec latency 143.871 ms 20 19142 16.56 MB/sec execute 96 sec latency 110.239 ms 20 19309 16.70 MB/sec execute 97 sec latency 131.715 ms 20 19432 16.55 MB/sec execute 98 sec latency 112.190 ms 20 19557 16.41 MB/sec execute 99 sec latency 145.897 ms 20 19696 16.28 MB/sec execute 100 sec latency 85.664 ms 20 19822 16.18 MB/sec execute 101 sec latency 107.158 ms 20 19984 16.12 MB/sec execute 102 sec latency 117.171 ms 20 20164 16.10 MB/sec execute 103 sec latency 106.226 ms 20 20355 16.27 MB/sec execute 104 sec latency 264.094 ms 20 20528 16.36 MB/sec execute 105 sec latency 167.483 ms 20 20723 16.48 MB/sec execute 106 sec latency 213.551 ms 20 20972 16.84 MB/sec execute 107 sec latency 183.397 ms 20 21158 16.86 MB/sec execute 108 sec latency 192.549 ms 20 21406 17.09 MB/sec execute 109 sec latency 138.516 ms 20 21584 17.15 MB/sec execute 110 sec latency 39.062 ms 20 21692 17.09 MB/sec execute 111 sec latency 171.807 ms 20 21800 16.96 MB/sec execute 112 sec latency 178.184 ms 20 21892 16.84 MB/sec execute 113 sec latency 170.358 ms 20 21984 16.71 MB/sec execute 114 sec latency 144.298 ms 20 22093 16.60 MB/sec execute 115 sec latency 171.492 ms 20 22172 16.49 MB/sec execute 116 sec latency 212.424 ms 20 22286 16.44 MB/sec execute 117 sec latency 163.116 ms 20 22425 16.42 MB/sec execute 118 sec latency 140.102 ms 20 22538 16.41 MB/sec execute 119 sec latency 146.233 ms 20 cleanup 120 sec 15 cleanup 121 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 63155 19.585 111.588 Close 46626 4.997 33.125 Rename 2714 24.725 75.728 Unlink 12608 6.870 38.949 Qpathinfo 56944 4.338 68.749 Qfileinfo 9925 0.131 20.820 Qfsinfo 10499 0.051 12.863 Sfileinfo 5352 13.725 45.310 Find 22070 0.700 46.610 WriteX 31276 1.569 25.866 ReadX 98904 0.019 7.448 LockX 200 5.837 13.722 UnlockX 200 6.065 14.405 Flush 4421 86.533 264.082 Throughput 16.4069 MB/sec 20 clients 20 procs max_latency=264.094 ms stopping dbench on /mnt/lustre/d0.oleg435-client.virtnet at Tue Apr 16 15:01:05 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg435-client.virtnet /mnt/lustre/d0.oleg435-client.virtnet /mnt/lustre/d0.oleg435-client.virtnet removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg435-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (151s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 15:01:12 (1713294072) min OST has 3313664kB available, using 4970496kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6933] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4854] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg435-clien 4854M 130181 90 122710 88 326471 81 1306 145 Latency 11478us 31455us 37424us 279ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg435-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 397 17 9200 36 501 12 395 17 944 13 396 13 Latency 19347us 12651us 55917us 14363us 4779us 20730us 1.97,1.97,oleg435-client.virtnet,1,1713302907,4854M,,,,130181,90,122710,88,,,326471,81,1306,145,10,,,,,397,17,9200,36,501,12,395,17,944,13,396,13,,11478us,31455us,,37424us,279ms,19347us,12651us,55917us,14363us,4779us,20730us debug=0x33f0484 PASS bonnie (217s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 15:04:51 (1713294291) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 25789 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 25789 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x262e19 truncating to largest ever: 0x2b4dbf truncating to largest ever: 0x54307c truncating to largest ever: 0x54df96 001000 1713294297.132268 read 0x2221f5 thru 0x23109c (0xeea8 bytes) truncating to largest ever: 0x54f2dd truncating to largest ever: 0x55aba9 003000 1713294307.999583 mapread 0x020ef5 thru 0x02f37d (0xe489 bytes) truncating to largest ever: 0x55e9fe 005000 1713294318.440638 mapwrite 0x4240f6 thru 0x42661c (0x2527 bytes) truncating to largest ever: 0x561fc1 006000 1713294323.134899 write 0x458876 thru 0x459a68 (0x11f3 bytes) 007000 1713294327.870492 read 0x2a5017 thru 0x2b2b8b (0xdb75 bytes) 009000 1713294339.354229 trunc from 0x455779 to 0x339f71 (0x11b807 bytes) truncating to largest ever: 0x562a3b 010000 1713294343.919981 trunc from 0x4fc1c8 to 0x507767 (0xb5a0 bytes) 013000 1713294358.492571 mapwrite 0x20c4bf thru 0x2119cc (0x550e bytes) 014000 1713294362.501928 write 0x48c186 thru 0x48f745 (0x35c0 bytes) 015000 1713294366.154453 mapread 0x0f5796 thru 0x103bf0 (0xe45b bytes) 017000 1713294374.708420 read 0x249e26 thru 0x24a6bc (0x897 bytes) 020000 1713294390.440621 mapwrite 0x1de485 thru 0x1ea380 (0xbefc bytes) 021000 1713294394.531357 read 0x3a5d3c thru 0x3b2ed0 (0xd195 bytes) 023000 1713294403.668687 mapread 0x350fe2 thru 0x356b86 (0x5ba5 bytes) 024000 1713294408.255698 mapread 0x1b2088 thru 0x1c1930 (0xf8a9 bytes) 026000 1713294418.240932 read 0x1fa057 thru 0x20826e (0xe218 bytes) 027000 1713294422.464835 mapwrite 0x000717 thru 0x0007c8 (0xb2 bytes) 031000 1713294441.138944 mapread 0x13ecde thru 0x13fb78 (0xe9b bytes) 035000 1713294460.613140 mapread 0x1d7dae thru 0x1de9ba (0x6c0d bytes) 036000 1713294465.315638 mapwrite 0x0c1d87 thru 0x0d06f3 (0xe96d bytes) 040000 1713294482.937407 trunc from 0x00d587 to 0x2a57db (0x298255 bytes) 041000 1713294486.670574 mapwrite 0x124984 thru 0x12d179 (0x87f6 bytes) 044000 1713294496.803578 mapwrite 0x07dac6 thru 0x07e075 (0x5b0 bytes) 045000 1713294500.215277 mapread 0x0607fe thru 0x06dd70 (0xd573 bytes) 046000 1713294503.723972 mapread 0x3b796b thru 0x3c65f4 (0xec8a bytes) 049000 1713294513.478488 mapread 0x204197 thru 0x20c4d6 (0x8340 bytes) 050000 1713294516.570968 write 0x1f9652 thru 0x1fa4ed (0xe9c bytes) 051000 1713294519.880031 mapread 0x0ab825 thru 0x0b3d87 (0x8563 bytes) 052000 1713294523.242899 write 0x2d73d3 thru 0x2e6e33 (0xfa61 bytes) 053000 1713294526.193502 write 0x4f41a3 thru 0x5028cd (0xe72b bytes) 054000 1713294529.018994 read 0x268946 thru 0x272d77 (0xa432 bytes) 055000 1713294532.609417 write 0x412fd3 thru 0x41e3e9 (0xb417 bytes) 056000 1713294535.698949 mapwrite 0x27d6c6 thru 0x2858df (0x821a bytes) 059000 1713294544.706500 mapread 0x000054 thru 0x00fe4f (0xfdfc bytes) 061000 1713294550.918613 mapread 0x03bccb thru 0x0460db (0xa411 bytes) 062000 1713294553.511090 read 0x54db2f thru 0x54e7dc (0xcae bytes) 063000 1713294557.049005 trunc from 0x53434d to 0x201eb2 (0x33249a bytes) 064000 1713294561.074822 trunc from 0x53ac84 to 0x553b7e (0x18efb bytes) 065000 1713294564.552575 write 0x0b2fbd thru 0x0c254b (0xf58f bytes) truncating to largest ever: 0x562a4f 069000 1713294577.231101 mapread 0x1b8004 thru 0x1b97cf (0x17cc bytes) 071000 1713294584.660328 trunc from 0x05cfdf to 0x03a07e (0x22f60 bytes) 072000 1713294588.009772 mapread 0x128af6 thru 0x1329e4 (0x9eef bytes) 073000 1713294591.382032 mapread 0x002fca thru 0x00b5d5 (0x860c bytes) 074000 1713294594.183548 trunc from 0x5060c2 to 0x2ffda7 (0x20631a bytes) 077000 1713294603.403692 trunc from 0x3be8ad to 0x316090 (0xa881c bytes) 078000 1713294606.287690 trunc from 0x34dcc7 to 0x25d6cc (0xf05fa bytes) 080000 1713294612.598640 mapread 0x140777 thru 0x148e8e (0x8718 bytes) 081000 1713294615.764295 mapwrite 0x043ffd thru 0x044665 (0x669 bytes) 083000 1713294621.434128 mapwrite 0x3540c7 thru 0x35bead (0x7de7 bytes) 084000 1713294624.514984 trunc from 0x4fe83e to 0x4b6e28 (0x47a15 bytes) 086000 1713294630.517211 read 0x39a9d5 thru 0x3a563f (0xac6b bytes) 087000 1713294633.155437 mapread 0x0570ed thru 0x065683 (0xe597 bytes) 088000 1713294635.678137 mapwrite 0x4fcd6e thru 0x4fdbce (0xe61 bytes) 089000 1713294638.836456 write 0x2e3d99 thru 0x2f03d1 (0xc639 bytes) 091000 1713294644.785898 mapwrite 0x18d2ea thru 0x18eafc (0x1813 bytes) 092000 1713294648.144877 mapwrite 0x1ac316 thru 0x1aeb0c (0x27f7 bytes) 093000 1713294651.851896 write 0x428a2d thru 0x437862 (0xee36 bytes) 094000 1713294655.083443 mapwrite 0x4d3851 thru 0x4e20de (0xe88e bytes) truncating to largest ever: 0x562c43 098000 1713294668.014890 trunc from 0x4aef23 to 0x0f2ef8 (0x3bc02a bytes) truncating to largest ever: 0x562d86 099000 1713294670.837673 trunc from 0x1556ad to 0x01d5d3 (0x1380d9 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (383s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 15:11:16 (1713294676) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713294686.223388 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713294694.284202 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713294698.081848 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713294712.467998 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713294715.659777 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713294727.765308 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713294730.726299 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713294737.324580 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713294744.274283 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713294747.174680 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713294752.892011 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713294756.368980 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713294769.550414 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713294775.789839 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713294785.643444 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713294796.238979 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713294799.338246 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713294813.946682 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713294817.964731 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713294827.696994 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713294830.985824 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713294834.331564 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713294843.109416 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713294849.380793 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713294855.251222 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713294858.439397 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713294891.126330 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713294899.929639 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713294903.374154 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713294906.699092 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713294909.986023 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713294919.701241 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713294922.930482 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713294932.653658 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713294936.415002 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713294946.544596 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713294957.260693 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713294960.914245 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713294970.969899 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713294987.876410 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713294990.882122 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713294997.249471 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713295003.972172 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (332s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1102 sec ===== 15:16:48 (1713295008) === sanity-benchmark: start cleanup 15:16:49 (1713295009) === === sanity-benchmark: finish cleanup 15:16:49 (1713295009) ===