-----============= acceptance-small: sanity-benchmark ============----- Thu Apr 18 03:23:15 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 03:23:19 (1713424999) === oleg450-client.virtnet: executing check_config_client /mnt/lustre oleg450-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg450-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6d06800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d06800.idle_timeout=debug disable quota as required oleg450-server: oleg450-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 03:23:27 (1713425007) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 03:23:29 (1713425009) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6900] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg450-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg450-client.virtnet at Thu Apr 18 03:23:29 EDT 2024 waiting for dbench pid 8912 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 212 165.03 MB/sec warmup 1 sec latency 87.641 ms 20 441 155.04 MB/sec warmup 2 sec latency 51.083 ms 20 685 141.11 MB/sec warmup 3 sec latency 258.020 ms 20 877 108.25 MB/sec warmup 4 sec latency 96.488 ms 20 1162 91.99 MB/sec warmup 5 sec latency 95.715 ms 20 1496 86.80 MB/sec warmup 6 sec latency 203.321 ms 20 1792 75.14 MB/sec warmup 7 sec latency 83.230 ms 20 2097 66.61 MB/sec warmup 8 sec latency 85.323 ms 20 2406 62.29 MB/sec warmup 9 sec latency 138.771 ms 20 2784 63.25 MB/sec warmup 10 sec latency 139.382 ms 20 3238 63.10 MB/sec warmup 11 sec latency 194.036 ms 20 3664 64.53 MB/sec warmup 12 sec latency 165.067 ms 20 3913 61.50 MB/sec warmup 13 sec latency 23.067 ms 20 4147 57.31 MB/sec warmup 14 sec latency 162.151 ms 20 4318 53.92 MB/sec warmup 15 sec latency 401.549 ms 20 4500 51.13 MB/sec warmup 16 sec latency 153.298 ms 20 4807 49.97 MB/sec warmup 17 sec latency 96.466 ms 20 5148 50.28 MB/sec warmup 18 sec latency 136.117 ms 20 5400 47.86 MB/sec warmup 19 sec latency 144.292 ms 20 5763 46.03 MB/sec warmup 20 sec latency 80.630 ms 20 6052 45.42 MB/sec warmup 21 sec latency 136.195 ms 20 6510 47.74 MB/sec warmup 22 sec latency 166.844 ms 20 7034 49.01 MB/sec warmup 23 sec latency 155.133 ms 20 7612 5.83 MB/sec execute 1 sec latency 22.302 ms 20 7811 5.32 MB/sec execute 2 sec latency 383.443 ms 20 7991 6.66 MB/sec execute 3 sec latency 148.086 ms 20 8286 11.76 MB/sec execute 4 sec latency 108.236 ms 20 8643 21.65 MB/sec execute 5 sec latency 93.191 ms 20 8903 18.80 MB/sec execute 6 sec latency 64.265 ms 20 9220 17.24 MB/sec execute 7 sec latency 71.209 ms 20 9520 18.52 MB/sec execute 8 sec latency 183.791 ms 20 9888 24.34 MB/sec execute 9 sec latency 175.819 ms 20 10369 28.52 MB/sec execute 10 sec latency 184.474 ms 20 10792 33.19 MB/sec execute 11 sec latency 92.817 ms 20 11048 32.32 MB/sec execute 12 sec latency 27.191 ms 20 11276 30.00 MB/sec execute 13 sec latency 151.464 ms 20 11445 28.38 MB/sec execute 14 sec latency 149.426 ms 20 11657 27.54 MB/sec execute 15 sec latency 127.451 ms 20 12027 29.48 MB/sec execute 16 sec latency 91.453 ms 20 12321 29.01 MB/sec execute 17 sec latency 107.735 ms 20 12595 27.66 MB/sec execute 18 sec latency 68.594 ms 20 12925 27.16 MB/sec execute 19 sec latency 82.578 ms 20 13183 27.32 MB/sec execute 20 sec latency 164.081 ms 20 13668 30.52 MB/sec execute 21 sec latency 141.635 ms 20 14161 32.87 MB/sec execute 22 sec latency 121.902 ms 20 14460 33.17 MB/sec execute 23 sec latency 27.001 ms 20 14675 32.10 MB/sec execute 24 sec latency 24.106 ms 20 14881 30.99 MB/sec execute 25 sec latency 354.193 ms 20 15030 30.06 MB/sec execute 26 sec latency 214.501 ms 20 15255 29.63 MB/sec execute 27 sec latency 132.239 ms 20 15653 31.14 MB/sec execute 28 sec latency 97.989 ms 20 15913 30.22 MB/sec execute 29 sec latency 82.037 ms 20 16204 29.40 MB/sec execute 30 sec latency 85.743 ms 20 16540 29.18 MB/sec execute 31 sec latency 112.389 ms 20 16884 30.03 MB/sec execute 32 sec latency 135.057 ms 20 17402 31.73 MB/sec execute 33 sec latency 193.122 ms 20 17844 33.18 MB/sec execute 34 sec latency 140.652 ms 20 18116 32.88 MB/sec execute 35 sec latency 21.706 ms 20 18311 32.06 MB/sec execute 36 sec latency 185.568 ms 20 18498 31.37 MB/sec execute 37 sec latency 178.442 ms 20 18664 30.77 MB/sec execute 38 sec latency 198.597 ms 20 18932 30.77 MB/sec execute 39 sec latency 124.098 ms 20 19277 31.38 MB/sec execute 40 sec latency 166.887 ms 20 19533 30.73 MB/sec execute 41 sec latency 104.479 ms 20 19835 30.16 MB/sec execute 42 sec latency 66.506 ms 20 20154 30.02 MB/sec execute 43 sec latency 98.759 ms 20 20481 30.64 MB/sec execute 44 sec latency 154.924 ms 20 20951 31.70 MB/sec execute 45 sec latency 145.319 ms 20 21364 32.53 MB/sec execute 46 sec latency 127.028 ms 20 21660 32.61 MB/sec execute 47 sec latency 22.582 ms 20 21843 32.02 MB/sec execute 48 sec latency 158.688 ms 20 22052 31.48 MB/sec execute 49 sec latency 198.660 ms 20 22223 31.09 MB/sec execute 50 sec latency 145.527 ms 20 22472 31.00 MB/sec execute 51 sec latency 148.892 ms 20 22827 31.45 MB/sec execute 52 sec latency 103.702 ms 20 23094 31.02 MB/sec execute 53 sec latency 86.893 ms 20 23384 30.58 MB/sec execute 54 sec latency 65.365 ms 20 23713 30.48 MB/sec execute 55 sec latency 92.183 ms 20 24020 30.89 MB/sec execute 56 sec latency 178.179 ms 20 24478 31.73 MB/sec execute 57 sec latency 159.526 ms 20 24889 32.34 MB/sec execute 58 sec latency 142.101 ms 20 25163 32.41 MB/sec execute 59 sec latency 169.936 ms 20 25360 32.00 MB/sec execute 60 sec latency 157.467 ms 20 25569 31.54 MB/sec execute 61 sec latency 145.002 ms 20 25727 31.19 MB/sec execute 62 sec latency 128.434 ms 20 25937 30.98 MB/sec execute 63 sec latency 128.304 ms 20 26252 31.07 MB/sec execute 64 sec latency 125.629 ms 20 26556 31.16 MB/sec execute 65 sec latency 98.079 ms 20 26820 30.83 MB/sec execute 66 sec latency 68.428 ms 20 27136 30.57 MB/sec execute 67 sec latency 86.261 ms 20 27452 30.73 MB/sec execute 68 sec latency 142.174 ms 20 27866 31.43 MB/sec execute 69 sec latency 131.991 ms 20 28296 31.75 MB/sec execute 70 sec latency 167.601 ms 20 28645 32.21 MB/sec execute 71 sec latency 96.732 ms 20 28870 31.97 MB/sec execute 72 sec latency 123.452 ms 20 29085 31.63 MB/sec execute 73 sec latency 176.677 ms 20 29242 31.28 MB/sec execute 74 sec latency 193.472 ms 20 29450 31.03 MB/sec execute 75 sec latency 100.104 ms 20 29727 31.03 MB/sec execute 76 sec latency 115.532 ms 20 30048 31.32 MB/sec execute 77 sec latency 106.797 ms 20 30294 30.99 MB/sec execute 78 sec latency 82.187 ms 20 30567 30.74 MB/sec execute 79 sec latency 78.741 ms 20 30917 30.80 MB/sec execute 80 sec latency 119.111 ms 20 31213 30.94 MB/sec execute 81 sec latency 132.193 ms 20 31607 31.42 MB/sec execute 82 sec latency 150.325 ms 20 32003 31.73 MB/sec execute 83 sec latency 132.688 ms 20 32303 31.92 MB/sec execute 84 sec latency 150.705 ms 20 32480 31.64 MB/sec execute 85 sec latency 114.364 ms 20 32677 31.30 MB/sec execute 86 sec latency 125.780 ms 20 32851 31.07 MB/sec execute 87 sec latency 194.876 ms 20 33056 30.87 MB/sec execute 88 sec latency 137.930 ms 20 33346 30.96 MB/sec execute 89 sec latency 128.046 ms 20 33663 31.08 MB/sec execute 90 sec latency 106.998 ms 20 33906 30.84 MB/sec execute 91 sec latency 86.192 ms 20 34201 30.69 MB/sec execute 92 sec latency 129.419 ms 20 34516 30.65 MB/sec execute 93 sec latency 120.180 ms 20 34820 30.86 MB/sec execute 94 sec latency 152.423 ms 20 35195 31.19 MB/sec execute 95 sec latency 156.087 ms 20 35583 31.47 MB/sec execute 96 sec latency 150.894 ms 20 35862 31.57 MB/sec execute 97 sec latency 129.052 ms 20 36056 31.35 MB/sec execute 98 sec latency 127.268 ms 20 36268 31.09 MB/sec execute 99 sec latency 116.773 ms 20 36452 30.90 MB/sec execute 100 sec latency 197.512 ms 20 36661 30.73 MB/sec execute 101 sec latency 108.293 ms 20 36983 30.83 MB/sec execute 102 sec latency 109.070 ms 20 37276 30.91 MB/sec execute 103 sec latency 89.069 ms 20 37535 30.78 MB/sec execute 104 sec latency 107.321 ms 20 37860 30.65 MB/sec execute 105 sec latency 99.007 ms 20 38169 30.67 MB/sec execute 106 sec latency 106.336 ms 20 38468 30.80 MB/sec execute 107 sec latency 151.009 ms 20 38843 31.11 MB/sec execute 108 sec latency 154.040 ms 20 39182 31.26 MB/sec execute 109 sec latency 137.416 ms 20 39450 31.35 MB/sec execute 110 sec latency 125.259 ms 20 39651 31.15 MB/sec execute 111 sec latency 148.562 ms 20 39847 30.95 MB/sec execute 112 sec latency 169.898 ms 20 40035 30.74 MB/sec execute 113 sec latency 153.401 ms 20 40252 30.62 MB/sec execute 114 sec latency 122.577 ms 20 40545 30.69 MB/sec execute 115 sec latency 99.088 ms 20 40870 30.84 MB/sec execute 116 sec latency 130.879 ms 20 41140 30.66 MB/sec execute 117 sec latency 112.330 ms 20 41433 30.54 MB/sec execute 118 sec latency 84.056 ms 20 41743 30.56 MB/sec execute 119 sec latency 110.836 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 120864 9.619 52.328 Close 88700 2.414 28.551 Rename 5053 12.805 44.839 Unlink 24411 4.154 35.147 Qpathinfo 109510 2.155 42.220 Qfileinfo 18999 0.062 7.765 Qfsinfo 19684 0.024 4.299 Sfileinfo 9982 6.305 30.992 Find 41891 0.408 36.521 WriteX 59243 0.761 15.993 ReadX 185714 0.010 1.811 LockX 382 2.809 9.907 UnlockX 382 2.835 9.950 Flush 8490 57.379 383.436 Throughput 30.5601 MB/sec 20 clients 20 procs max_latency=383.443 ms stopping dbench on /mnt/lustre/d0.oleg450-client.virtnet at Thu Apr 18 03:25:54 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg450-client.virtnet /mnt/lustre/d0.oleg450-client.virtnet /mnt/lustre/d0.oleg450-client.virtnet removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg450-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 03:25:58 (1713425158) min OST has 3116032kB available, using 4674048kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6900] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4564] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg450-clien 4564M 169346 99 156841 96 451718 77 2484 134 Latency 2032us 22602us 26457us 323ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg450-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 395 16 9151 28 579 11 413 15 1121 12 610 11 Latency 19646us 12941us 75344us 16305us 8376us 9958us 1.97,1.97,oleg450-client.virtnet,1,1713433709,4564M,,,,169346,99,156841,96,,,451718,77,2484,134,10,,,,,395,16,9151,28,579,11,413,15,1121,12,610,11,,2032us,22602us,,26457us,323ms,19646us,12941us,75344us,16305us,8376us,9958us debug=0x33f0484 PASS bonnie (172s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 03:28:52 (1713425332) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 16447 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 16447 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x3995e truncating to largest ever: 0xa08bd truncating to largest ever: 0x1a6a28 truncating to largest ever: 0x2231c0 truncating to largest ever: 0x2dce30 truncating to largest ever: 0x528f5f truncating to largest ever: 0x55a66d truncating to largest ever: 0x55f951 002000 1713425339.232933 read 0x373d2a thru 0x380b4c (0xce23 bytes) truncating to largest ever: 0x56110d 005000 1713425347.281932 write 0x4b6d8a thru 0x4bdd1b (0x6f92 bytes) 006000 1713425350.415025 write 0x114b5b thru 0x1151c7 (0x66d bytes) 008000 1713425356.319398 mapwrite 0x499d5e thru 0x4a873b (0xe9de bytes) 009000 1713425359.194689 read 0x1146b0 thru 0x119155 (0x4aa6 bytes) 010000 1713425362.092868 trunc from 0x4ec9c4 to 0x540c8a (0x542c7 bytes) 013000 1713425370.585729 write 0x4d4159 thru 0x4da87c (0x6724 bytes) 014000 1713425373.609033 mapread 0x3b587b thru 0x3bcd0e (0x7494 bytes) truncating to largest ever: 0x562c95 015000 1713425376.546501 read 0x38af61 thru 0x38e30d (0x33ad bytes) 016000 1713425380.161911 trunc from 0x479b3d to 0x3f035e (0x897de bytes) 017000 1713425383.223304 read 0x2e3835 thru 0x2ee6ad (0xae79 bytes) 018000 1713425386.608228 trunc from 0x48224b to 0x1df9ec (0x2a285e bytes) 020000 1713425392.903606 read 0x147ad3 thru 0x14efbe (0x74ec bytes) 021000 1713425395.593089 mapread 0x3015dc thru 0x30328a (0x1caf bytes) 022000 1713425398.519076 write 0x561b21 thru 0x562dff (0x12df bytes) 024000 1713425404.364872 write 0x419a5b thru 0x4249cf (0xaf75 bytes) 025000 1713425408.238701 read 0x01fed0 thru 0x023ea1 (0x3fd2 bytes) 028000 1713425417.502008 write 0x031d2a thru 0x03a350 (0x8627 bytes) 029000 1713425420.268233 mapread 0x043073 thru 0x04a9d2 (0x7960 bytes) 031000 1713425425.850958 read 0x3d52e4 thru 0x3d67ee (0x150b bytes) 032000 1713425428.581266 mapwrite 0x37f842 thru 0x38c083 (0xc842 bytes) 033000 1713425431.207347 trunc from 0x378224 to 0x16ddcd (0x20a456 bytes) 034000 1713425434.169987 mapwrite 0x1fa3c3 thru 0x20919a (0xedd8 bytes) 035000 1713425436.874522 mapwrite 0x4472a9 thru 0x4475b1 (0x309 bytes) 036000 1713425439.540802 mapwrite 0x401c10 thru 0x40da6f (0xbe60 bytes) 038000 1713425445.477743 read 0x160ac5 thru 0x16c442 (0xb97e bytes) 044000 1713425462.247113 trunc from 0x47ac1c to 0x18870e (0x2f250d bytes) 045000 1713425465.381722 trunc from 0x41c17e to 0x3d909f (0x430de bytes) 046000 1713425468.310863 trunc from 0x37dbee to 0x17da12 (0x2001db bytes) 048000 1713425473.640847 write 0x2322ce thru 0x23a94b (0x867e bytes) 050000 1713425479.259340 mapwrite 0x374562 thru 0x37b9ac (0x744b bytes) 052000 1713425484.729951 write 0x16e80a thru 0x17763f (0x8e36 bytes) 054000 1713425490.506843 mapread 0x12d6b8 thru 0x135b56 (0x849f bytes) 056000 1713425497.995597 mapwrite 0x26f892 thru 0x278291 (0x8a00 bytes) 057000 1713425501.278600 write 0x0b54f4 thru 0x0b6dd0 (0x18dd bytes) 058000 1713425504.459122 read 0x2c368b thru 0x2d2429 (0xed9f bytes) 061000 1713425515.351580 mapwrite 0x469a05 thru 0x46c96a (0x2f66 bytes) 062000 1713425518.566180 mapwrite 0x31e4f5 thru 0x32d1ef (0xecfb bytes) 063000 1713425521.439386 write 0x4d0523 thru 0x4db88c (0xb36a bytes) 064000 1713425524.520674 read 0x13cec3 thru 0x13e9f5 (0x1b33 bytes) 067000 1713425535.151188 write 0x07ee33 thru 0x07ff02 (0x10d0 bytes) 068000 1713425537.877122 read 0x114429 thru 0x122966 (0xe53e bytes) 069000 1713425541.554170 mapread 0x02f3dd thru 0x03e437 (0xf05b bytes) 070000 1713425544.433677 write 0x4f7be2 thru 0x4fcf4c (0x536b bytes) 071000 1713425547.783688 mapread 0x23b0a8 thru 0x241d38 (0x6c91 bytes) 073000 1713425555.069173 write 0x11c9f7 thru 0x12250a (0x5b14 bytes) 075000 1713425561.202786 write 0x43ce48 thru 0x445b39 (0x8cf2 bytes) 076000 1713425563.996347 mapwrite 0x1d741f thru 0x1dbf0e (0x4af0 bytes) 078000 1713425569.743763 mapwrite 0x4c3299 thru 0x4c5235 (0x1f9d bytes) 084000 1713425589.388472 write 0x1776ed thru 0x17a94d (0x3261 bytes) 087000 1713425599.701455 mapread 0x2300f0 thru 0x236b3b (0x6a4c bytes) 090000 1713425610.265446 write 0x0d47b0 thru 0x0e22d6 (0xdb27 bytes) 091000 1713425614.518228 read 0x49ef04 thru 0x4a5300 (0x63fd bytes) 093000 1713425621.068797 read 0x0b8e2b thru 0x0bf655 (0x682b bytes) 094000 1713425623.761370 read 0x3f1eed thru 0x3fc23d (0xa351 bytes) 095000 1713425626.306304 write 0x241920 thru 0x242042 (0x723 bytes) 096000 1713425629.449150 mapwrite 0x07680e thru 0x07818f (0x1982 bytes) 098000 1713425635.156114 trunc from 0x537d29 to 0x1a1787 (0x3965a1 bytes) 099000 1713425638.260218 trunc from 0x4e112c to 0x1970f0 (0x34a03b bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (311s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 03:34:05 (1713425645) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713425654.412112 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713425661.287856 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713425664.514215 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713425677.545533 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713425680.422157 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713425692.092978 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713425695.021339 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713425700.907746 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713425707.120042 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713425710.188118 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713425716.329401 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713425719.979842 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713425732.097395 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713425737.832913 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713425748.312114 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713425760.288901 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713425763.230928 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713425776.704460 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713425780.692116 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713425790.633127 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713425794.024601 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713425797.480490 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713425807.280944 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713425816.314338 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713425821.917411 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713425825.053856 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713425856.653270 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713425865.887860 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713425869.365645 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713425872.310396 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713425875.352172 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713425885.171151 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713425888.431273 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713425899.284788 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713425903.102047 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713425912.267441 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713425921.823517 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713425925.144580 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713425933.838297 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713425949.055804 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713425952.047711 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713425959.112479 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713425965.821743 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (325s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 975 sec ====== 03:39:30 (1713425970) === sanity-benchmark: start cleanup 03:39:30 (1713425970) === === sanity-benchmark: finish cleanup 03:39:31 (1713425971) ===