-----============= acceptance-small: sanity-benchmark ============----- Wed Apr 17 10:29:41 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:29:44 (1713364184) === oleg247-client.virtnet: executing check_config_client /mnt/lustre oleg247-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg247-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b58fd800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b58fd800.idle_timeout=debug disable quota as required oleg247-server: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:29:52 (1713364192) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 10:29:53 (1713364193) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6910] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg247-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg247-client.virtnet at Wed Apr 17 10:29:53 EDT 2024 waiting for dbench pid 8920 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 214 166.95 MB/sec warmup 1 sec latency 96.097 ms 20 441 155.14 MB/sec warmup 2 sec latency 50.343 ms 20 681 141.14 MB/sec warmup 3 sec latency 361.476 ms 20 873 108.25 MB/sec warmup 4 sec latency 96.413 ms 20 1128 91.91 MB/sec warmup 5 sec latency 103.386 ms 20 1469 86.76 MB/sec warmup 6 sec latency 128.204 ms 20 1729 75.01 MB/sec warmup 7 sec latency 157.080 ms 20 2033 66.39 MB/sec warmup 8 sec latency 86.684 ms 20 2369 62.06 MB/sec warmup 9 sec latency 113.071 ms 20 2664 60.36 MB/sec warmup 10 sec latency 118.260 ms 20 3106 61.72 MB/sec warmup 11 sec latency 136.178 ms 20 3590 64.13 MB/sec warmup 12 sec latency 150.228 ms 20 3858 61.19 MB/sec warmup 13 sec latency 25.263 ms 20 4084 57.26 MB/sec warmup 14 sec latency 24.652 ms 20 4285 53.81 MB/sec warmup 15 sec latency 272.914 ms 20 4441 50.92 MB/sec warmup 16 sec latency 202.243 ms 20 4709 49.54 MB/sec warmup 17 sec latency 116.981 ms 20 5058 50.18 MB/sec warmup 18 sec latency 86.630 ms 20 5321 47.79 MB/sec warmup 19 sec latency 100.285 ms 20 5656 45.86 MB/sec warmup 20 sec latency 58.939 ms 20 6003 45.25 MB/sec warmup 21 sec latency 115.274 ms 20 6483 47.38 MB/sec warmup 22 sec latency 134.598 ms 20 6946 47.95 MB/sec warmup 23 sec latency 125.068 ms 20 7562 13.50 MB/sec execute 1 sec latency 116.896 ms 20 7770 8.28 MB/sec execute 2 sec latency 237.959 ms 20 7925 7.95 MB/sec execute 3 sec latency 146.336 ms 20 8141 10.44 MB/sec execute 4 sec latency 110.369 ms 20 8479 17.24 MB/sec execute 5 sec latency 97.150 ms 20 8774 19.72 MB/sec execute 6 sec latency 106.449 ms 20 9038 17.89 MB/sec execute 7 sec latency 69.181 ms 20 9389 17.99 MB/sec execute 8 sec latency 82.867 ms 20 9697 20.65 MB/sec execute 9 sec latency 118.663 ms 20 10116 27.05 MB/sec execute 10 sec latency 201.909 ms 20 10527 29.20 MB/sec execute 11 sec latency 123.091 ms 20 10893 31.86 MB/sec execute 12 sec latency 93.854 ms 20 11109 30.49 MB/sec execute 13 sec latency 130.827 ms 20 11317 28.56 MB/sec execute 14 sec latency 96.459 ms 20 11494 27.29 MB/sec execute 15 sec latency 140.444 ms 20 11709 26.83 MB/sec execute 16 sec latency 118.232 ms 20 12017 27.26 MB/sec execute 17 sec latency 103.457 ms 20 12332 27.88 MB/sec execute 18 sec latency 85.829 ms 20 12591 26.87 MB/sec execute 19 sec latency 85.557 ms 20 12908 26.40 MB/sec execute 20 sec latency 115.947 ms 20 13241 27.06 MB/sec execute 21 sec latency 138.695 ms 20 13659 29.58 MB/sec execute 22 sec latency 148.388 ms 20 14035 30.18 MB/sec execute 23 sec latency 142.937 ms 20 14396 31.53 MB/sec execute 24 sec latency 98.402 ms 20 14604 31.05 MB/sec execute 25 sec latency 224.507 ms 20 14783 30.03 MB/sec execute 26 sec latency 127.723 ms 20 14984 29.20 MB/sec execute 27 sec latency 159.208 ms 20 15181 28.87 MB/sec execute 28 sec latency 140.050 ms 20 15406 28.47 MB/sec execute 29 sec latency 102.838 ms 20 15760 29.13 MB/sec execute 30 sec latency 98.196 ms 20 16044 28.75 MB/sec execute 31 sec latency 80.263 ms 20 16317 28.33 MB/sec execute 32 sec latency 81.450 ms 20 16681 28.50 MB/sec execute 33 sec latency 90.566 ms 20 16970 28.80 MB/sec execute 34 sec latency 119.467 ms 20 17355 30.08 MB/sec execute 35 sec latency 147.338 ms 20 17750 30.72 MB/sec execute 36 sec latency 183.053 ms 20 18040 31.07 MB/sec execute 37 sec latency 121.693 ms 20 18228 30.59 MB/sec execute 38 sec latency 114.455 ms 20 18441 29.97 MB/sec execute 39 sec latency 200.053 ms 20 18628 29.65 MB/sec execute 40 sec latency 310.894 ms 20 18801 29.08 MB/sec execute 41 sec latency 114.354 ms 20 19035 28.83 MB/sec execute 42 sec latency 140.419 ms 20 19392 29.35 MB/sec execute 43 sec latency 94.930 ms 20 19674 29.22 MB/sec execute 44 sec latency 86.486 ms 20 19965 28.98 MB/sec execute 45 sec latency 94.703 ms 20 20311 28.95 MB/sec execute 46 sec latency 81.072 ms 20 20590 29.07 MB/sec execute 47 sec latency 122.325 ms 20 20995 29.92 MB/sec execute 48 sec latency 133.431 ms 20 21409 30.47 MB/sec execute 49 sec latency 143.918 ms 20 21717 30.78 MB/sec execute 50 sec latency 98.825 ms 20 21975 30.56 MB/sec execute 51 sec latency 134.523 ms 20 22235 30.18 MB/sec execute 52 sec latency 186.001 ms 20 22453 29.78 MB/sec execute 53 sec latency 112.303 ms 20 22754 29.82 MB/sec execute 54 sec latency 95.394 ms 20 23134 30.42 MB/sec execute 55 sec latency 81.347 ms 20 23454 30.19 MB/sec execute 56 sec latency 78.982 ms 20 23803 30.05 MB/sec execute 57 sec latency 61.911 ms 20 24148 30.17 MB/sec execute 58 sec latency 112.617 ms 20 24623 30.97 MB/sec execute 59 sec latency 115.182 ms 20 25040 31.47 MB/sec execute 60 sec latency 144.882 ms 20 25340 31.65 MB/sec execute 61 sec latency 111.408 ms 20 25598 31.41 MB/sec execute 62 sec latency 129.768 ms 20 25832 31.00 MB/sec execute 63 sec latency 116.680 ms 20 26077 30.73 MB/sec execute 64 sec latency 122.623 ms 20 26389 30.82 MB/sec execute 65 sec latency 88.734 ms 20 26780 31.25 MB/sec execute 66 sec latency 98.328 ms 20 27099 31.10 MB/sec execute 67 sec latency 78.045 ms 20 27452 30.94 MB/sec execute 68 sec latency 86.644 ms 20 27780 31.03 MB/sec execute 69 sec latency 127.740 ms 20 28200 31.59 MB/sec execute 70 sec latency 156.538 ms 20 28628 32.12 MB/sec execute 71 sec latency 110.688 ms 20 28927 32.22 MB/sec execute 72 sec latency 85.891 ms 20 29164 31.92 MB/sec execute 73 sec latency 138.285 ms 20 29385 31.56 MB/sec execute 74 sec latency 142.064 ms 20 29590 31.29 MB/sec execute 75 sec latency 169.548 ms 20 29896 31.37 MB/sec execute 76 sec latency 102.326 ms 20 30294 31.75 MB/sec execute 77 sec latency 92.013 ms 20 30609 31.62 MB/sec execute 78 sec latency 63.786 ms 20 30952 31.40 MB/sec execute 79 sec latency 59.212 ms 20 31274 31.43 MB/sec execute 80 sec latency 113.447 ms 20 31696 31.99 MB/sec execute 81 sec latency 112.058 ms 20 32131 32.36 MB/sec execute 82 sec latency 137.764 ms 20 32485 32.55 MB/sec execute 83 sec latency 102.980 ms 20 32734 32.30 MB/sec execute 84 sec latency 116.022 ms 20 32988 32.01 MB/sec execute 85 sec latency 114.239 ms 20 33241 31.85 MB/sec execute 86 sec latency 105.338 ms 20 33622 32.10 MB/sec execute 87 sec latency 95.086 ms 20 34021 32.33 MB/sec execute 88 sec latency 105.851 ms 20 34311 32.10 MB/sec execute 89 sec latency 66.083 ms 20 34689 32.02 MB/sec execute 90 sec latency 70.808 ms 20 35063 32.28 MB/sec execute 91 sec latency 131.077 ms 20 35524 32.64 MB/sec execute 92 sec latency 138.940 ms 20 35917 33.01 MB/sec execute 93 sec latency 106.635 ms 20 36192 32.92 MB/sec execute 94 sec latency 105.275 ms 20 36420 32.62 MB/sec execute 95 sec latency 116.636 ms 20 36638 32.41 MB/sec execute 96 sec latency 148.906 ms 20 36870 32.31 MB/sec execute 97 sec latency 123.376 ms 20 37199 32.42 MB/sec execute 98 sec latency 121.572 ms 20 37546 32.58 MB/sec execute 99 sec latency 122.843 ms 20 37826 32.42 MB/sec execute 100 sec latency 58.670 ms 20 38121 32.25 MB/sec execute 101 sec latency 80.602 ms 20 38413 32.24 MB/sec execute 102 sec latency 128.985 ms 20 38730 32.43 MB/sec execute 103 sec latency 161.222 ms 20 39122 32.66 MB/sec execute 104 sec latency 122.566 ms 20 39464 32.87 MB/sec execute 105 sec latency 105.330 ms 20 39724 32.80 MB/sec execute 106 sec latency 91.828 ms 20 39936 32.56 MB/sec execute 107 sec latency 122.668 ms 20 40167 32.34 MB/sec execute 108 sec latency 114.217 ms 20 40374 32.22 MB/sec execute 109 sec latency 140.532 ms 20 40661 32.26 MB/sec execute 110 sec latency 150.854 ms 20 41005 32.44 MB/sec execute 111 sec latency 92.531 ms 20 41279 32.36 MB/sec execute 112 sec latency 86.539 ms 20 41546 32.18 MB/sec execute 113 sec latency 78.796 ms 20 41858 32.08 MB/sec execute 114 sec latency 101.451 ms 20 42149 32.16 MB/sec execute 115 sec latency 139.413 ms 20 42541 32.44 MB/sec execute 116 sec latency 115.625 ms 20 42930 32.63 MB/sec execute 117 sec latency 89.418 ms 20 43218 32.69 MB/sec execute 118 sec latency 117.663 ms 20 43439 32.49 MB/sec execute 119 sec latency 151.234 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 126981 9.207 74.308 Close 92591 2.204 26.151 Rename 5269 12.315 44.635 Unlink 26145 3.855 40.509 Qpathinfo 114584 2.114 34.709 Qfileinfo 19679 0.066 8.641 Qfsinfo 20861 0.025 3.194 Sfileinfo 10228 5.963 24.317 Find 43955 0.415 31.273 WriteX 61732 0.740 22.427 ReadX 194978 0.011 2.509 LockX 400 2.793 20.694 UnlockX 400 2.745 12.205 Flush 8837 54.756 310.886 Throughput 32.4852 MB/sec 20 clients 20 procs max_latency=310.894 ms stopping dbench on /mnt/lustre/d0.oleg247-client.virtnet at Wed Apr 17 10:32:18 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg247-client.virtnet /mnt/lustre/d0.oleg247-client.virtnet /mnt/lustre/d0.oleg247-client.virtnet removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg247-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 10:32:22 (1713364342) min OST has 3297280kB available, using 4945920kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6910] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4830] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg247-clien 4830M 155406 98 143835 95 405811 83 2409 121 Latency 1841us 34878us 43933us 340ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg247-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 285 15 3943 20 424 13 374 16 1202 12 509 11 Latency 19918us 40312us 71779us 14976us 2537us 14806us 1.97,1.97,oleg247-client.virtnet,1,1713371894,4830M,,,,155406,98,143835,95,,,405811,83,2409,121,10,,,,,285,15,3943,20,424,13,374,16,1202,12,509,11,,1841us,34878us,,43933us,340ms,19918us,40312us,71779us,14976us,2537us,14806us debug=0x33f0484 PASS bonnie (206s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 10:35:50 (1713364550) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 27421 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 27421 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x28aa06 truncating to largest ever: 0x35d7bf truncating to largest ever: 0x3f4c78 truncating to largest ever: 0x458799 truncating to largest ever: 0x471ea7 truncating to largest ever: 0x4d00f2 truncating to largest ever: 0x51e41b truncating to largest ever: 0x546d35 truncating to largest ever: 0x558e2e truncating to largest ever: 0x559e63 002000 1713364556.871168 mapwrite 0x264838 thru 0x2657fe (0xfc7 bytes) 003000 1713364560.007055 trunc from 0x54b4a8 to 0x36d90a (0x1ddb9d bytes) 004000 1713364562.871977 write 0x3c3384 thru 0x3cb11c (0x7d99 bytes) truncating to largest ever: 0x55d03d truncating to largest ever: 0x561a52 005000 1713364565.943811 trunc from 0x504b46 to 0x0c28e1 (0x442264 bytes) 006000 1713364569.161584 write 0x504f3e thru 0x505fe0 (0x10a3 bytes) 008000 1713364575.711289 mapwrite 0x2257c2 thru 0x22e2bb (0x8afa bytes) skipping zero size write 011000 1713364585.178268 mapwrite 0x34bbc2 thru 0x353d8d (0x81cc bytes) truncating to largest ever: 0x562200 014000 1713364596.127026 mapread 0x347628 thru 0x34d087 (0x5a60 bytes) skipping zero size read truncating to largest ever: 0x562b82 015000 1713364600.905732 read 0x454af5 thru 0x45e4f1 (0x99fd bytes) 017000 1713364607.583926 mapread 0x0749e6 thru 0x0782e7 (0x3902 bytes) 020000 1713364618.513375 mapread 0x2b35ba thru 0x2b8eaf (0x58f6 bytes) 021000 1713364622.145996 mapwrite 0x473bce thru 0x48055e (0xc991 bytes) 024000 1713364632.981191 mapwrite 0x082601 thru 0x08b18b (0x8b8b bytes) 025000 1713364636.695889 trunc from 0x0b42e1 to 0x44f312 (0x39b032 bytes) 028000 1713364647.359281 trunc from 0x503c13 to 0x48fc31 (0x73fe1 bytes) 032000 1713364661.301067 mapread 0x163cc0 thru 0x16ae53 (0x7194 bytes) 035000 1713364671.829912 mapread 0x21cf29 thru 0x22c44b (0xf523 bytes) 036000 1713364674.558915 trunc from 0x3ea70b to 0x38a417 (0x602f3 bytes) 041000 1713364693.724634 mapread 0x26f419 thru 0x278fd2 (0x9bba bytes) 043000 1713364703.423121 write 0x0a783f thru 0x0a864e (0xe10 bytes) 044000 1713364708.508355 write 0x16b302 thru 0x17a58d (0xf28c bytes) 046000 1713364715.530392 read 0x3bf45c thru 0x3c8f4a (0x9aef bytes) 047000 1713364718.824042 mapread 0x46414c thru 0x472286 (0xe13b bytes) 048000 1713364722.264866 read 0x152a2f thru 0x160474 (0xda46 bytes) 050000 1713364729.152866 trunc from 0x3795e8 to 0x526dde (0x1ad7f7 bytes) 054000 1713364742.163579 mapwrite 0x428b7b thru 0x432503 (0x9989 bytes) 057000 1713364751.919515 read 0x087de0 thru 0x095a17 (0xdc38 bytes) 058000 1713364755.214605 read 0x010016 thru 0x0199c9 (0x99b4 bytes) 061000 1713364765.285643 mapwrite 0x1804e5 thru 0x186279 (0x5d95 bytes) 063000 1713364771.437926 trunc from 0x47cc62 to 0x0b815d (0x3c4b04 bytes) 065000 1713364777.578065 mapread 0x09acd7 thru 0x0a9767 (0xea91 bytes) 066000 1713364780.785652 trunc from 0x52b2cd to 0x3d3ebb (0x157411 bytes) 068000 1713364786.551725 mapwrite 0x4d8cd3 thru 0x4e26f7 (0x9a25 bytes) 075000 1713364809.151406 write 0x4fb1c6 thru 0x504cf8 (0x9b33 bytes) 077000 1713364815.256404 trunc from 0x31a795 to 0x42aaea (0x110356 bytes) 078000 1713364818.415194 mapwrite 0x0f0713 thru 0x0fc2bd (0xbbab bytes) 079000 1713364821.699688 trunc from 0x2966f1 to 0x2c010b (0x29a1b bytes) 080000 1713364825.051884 read 0x046bd7 thru 0x04aa36 (0x3e60 bytes) 082000 1713364830.272132 read 0x0dfcd2 thru 0x0ede59 (0xe188 bytes) 084000 1713364835.560036 trunc from 0x51fb5d to 0x1ad55d (0x3725ff bytes) 085000 1713364838.198337 read 0x178d9d thru 0x187547 (0xe7ab bytes) 086000 1713364840.737530 mapread 0x0a8c95 thru 0x0b66c9 (0xda35 bytes) 089000 1713364848.776457 read 0x08b612 thru 0x08f945 (0x4334 bytes) 091000 1713364853.629066 mapread 0x44cffe thru 0x45ce73 (0xfe76 bytes) 095000 1713364864.542874 mapwrite 0x29db7d thru 0x2a87d8 (0xac5c bytes) 098000 1713364873.674575 read 0x01fa2f thru 0x029a9a (0xa06c bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (330s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 10:41:22 (1713364882) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713364893.444170 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713364902.092512 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713364906.816776 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713364924.467640 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713364928.167927 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713364944.133395 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713364948.237295 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713364956.025705 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713364963.646022 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713364967.228648 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713364975.139313 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713364979.819633 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713364994.042108 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713365000.450294 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713365012.007618 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713365021.456959 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713365024.388012 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713365038.381849 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713365042.236490 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713365053.494080 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713365056.836837 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713365060.507383 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713365069.686428 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713365076.079312 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713365083.770402 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713365087.656328 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713365120.229209 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713365129.598942 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713365133.350568 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713365136.473991 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713365139.902485 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713365150.597461 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713365153.779809 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713365164.151763 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713365167.674382 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713365176.786503 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713365186.995802 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713365190.393248 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713365199.033411 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713365213.393238 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713365216.283680 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713365222.345550 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713365228.942308 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (350s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1052 sec ===== 10:47:13 (1713365233) === sanity-benchmark: start cleanup 10:47:13 (1713365233) === === sanity-benchmark: finish cleanup 10:47:13 (1713365233) ===