-----============= acceptance-small: sanity-benchmark ============----- Tue Apr 16 10:49:32 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:49:37 (1713278977) === oleg322-client.virtnet: executing check_config_client /mnt/lustre oleg322-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg322-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012aacd800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aacd800.idle_timeout=debug disable quota as required oleg322-server: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 10:49:45 (1713278985) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 10:49:46 (1713278986) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6897] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg322-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg322-client.virtnet at Tue Apr 16 10:49:47 EDT 2024 waiting for dbench pid 8908 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 203 160.27 MB/sec warmup 1 sec latency 97.574 ms 20 424 149.45 MB/sec warmup 2 sec latency 43.577 ms 20 667 141.02 MB/sec warmup 3 sec latency 280.341 ms 20 843 107.69 MB/sec warmup 4 sec latency 99.509 ms 20 1067 91.58 MB/sec warmup 5 sec latency 98.165 ms 20 1421 86.70 MB/sec warmup 6 sec latency 94.450 ms 20 1657 74.85 MB/sec warmup 7 sec latency 140.198 ms 20 1923 66.05 MB/sec warmup 8 sec latency 72.958 ms 20 2242 60.19 MB/sec warmup 9 sec latency 92.560 ms 20 2499 57.23 MB/sec warmup 10 sec latency 128.718 ms 20 2933 60.35 MB/sec warmup 11 sec latency 191.767 ms 20 3345 59.22 MB/sec warmup 12 sec latency 126.137 ms 20 3734 60.24 MB/sec warmup 13 sec latency 70.057 ms 20 3971 57.23 MB/sec warmup 14 sec latency 27.548 ms 20 4161 53.51 MB/sec warmup 15 sec latency 183.874 ms 20 4312 50.56 MB/sec warmup 16 sec latency 278.854 ms 20 4481 48.05 MB/sec warmup 17 sec latency 127.560 ms 20 4746 47.13 MB/sec warmup 18 sec latency 180.034 ms 20 5061 47.55 MB/sec warmup 19 sec latency 82.466 ms 20 5260 45.34 MB/sec warmup 20 sec latency 78.137 ms 20 5492 43.37 MB/sec warmup 21 sec latency 80.220 ms 20 5798 41.94 MB/sec warmup 22 sec latency 76.579 ms 20 6032 41.47 MB/sec warmup 23 sec latency 166.276 ms 20 6856 56.76 MB/sec execute 1 sec latency 173.723 ms 20 7259 65.79 MB/sec execute 2 sec latency 122.699 ms 20 7508 51.11 MB/sec execute 3 sec latency 25.270 ms 20 7732 38.88 MB/sec execute 4 sec latency 216.842 ms 20 7904 32.63 MB/sec execute 5 sec latency 136.034 ms 20 8106 29.57 MB/sec execute 6 sec latency 115.431 ms 20 8439 31.45 MB/sec execute 7 sec latency 133.917 ms 20 8746 32.25 MB/sec execute 8 sec latency 92.021 ms 20 8996 29.14 MB/sec execute 9 sec latency 77.414 ms 20 9312 27.55 MB/sec execute 10 sec latency 133.034 ms 20 9609 28.09 MB/sec execute 11 sec latency 120.687 ms 20 10076 33.39 MB/sec execute 12 sec latency 157.881 ms 20 10539 36.04 MB/sec execute 13 sec latency 153.928 ms 20 10895 37.50 MB/sec execute 14 sec latency 89.954 ms 20 11104 35.73 MB/sec execute 15 sec latency 185.721 ms 20 11343 33.78 MB/sec execute 16 sec latency 206.575 ms 20 11494 32.28 MB/sec execute 17 sec latency 130.209 ms 20 11724 31.53 MB/sec execute 18 sec latency 135.054 ms 20 12109 33.56 MB/sec execute 19 sec latency 115.853 ms 20 12356 32.07 MB/sec execute 20 sec latency 72.880 ms 20 12629 30.84 MB/sec execute 21 sec latency 75.392 ms 20 12970 30.45 MB/sec execute 22 sec latency 81.867 ms 20 13279 31.04 MB/sec execute 23 sec latency 161.893 ms 20 13744 33.30 MB/sec execute 24 sec latency 160.081 ms 20 14180 34.90 MB/sec execute 25 sec latency 148.029 ms 20 14486 35.08 MB/sec execute 26 sec latency 48.310 ms 20 14681 34.03 MB/sec execute 27 sec latency 181.199 ms 20 14899 32.97 MB/sec execute 28 sec latency 196.397 ms 20 15045 32.11 MB/sec execute 29 sec latency 127.745 ms 20 15263 31.63 MB/sec execute 30 sec latency 136.038 ms 20 15634 32.57 MB/sec execute 31 sec latency 103.414 ms 20 15908 32.00 MB/sec execute 32 sec latency 95.012 ms 20 16174 31.21 MB/sec execute 33 sec latency 67.793 ms 20 16531 31.05 MB/sec execute 34 sec latency 79.623 ms 20 16886 31.77 MB/sec execute 35 sec latency 135.189 ms 20 17376 33.14 MB/sec execute 36 sec latency 138.033 ms 20 17837 34.48 MB/sec execute 37 sec latency 156.309 ms 20 18104 34.15 MB/sec execute 38 sec latency 146.188 ms 20 18333 33.40 MB/sec execute 39 sec latency 136.085 ms 20 18527 32.76 MB/sec execute 40 sec latency 326.228 ms 20 18751 32.35 MB/sec execute 41 sec latency 117.067 ms 20 19076 32.34 MB/sec execute 42 sec latency 114.070 ms 20 19423 32.70 MB/sec execute 43 sec latency 79.738 ms 20 19711 32.13 MB/sec execute 44 sec latency 101.914 ms 20 20087 31.84 MB/sec execute 45 sec latency 102.522 ms 20 20471 32.45 MB/sec execute 46 sec latency 114.926 ms 20 20921 33.50 MB/sec execute 47 sec latency 124.206 ms 20 21362 34.17 MB/sec execute 48 sec latency 136.011 ms 20 21661 34.29 MB/sec execute 49 sec latency 98.732 ms 20 21863 33.72 MB/sec execute 50 sec latency 93.641 ms 20 22104 33.25 MB/sec execute 51 sec latency 113.528 ms 20 22300 32.86 MB/sec execute 52 sec latency 137.043 ms 20 22612 32.85 MB/sec execute 53 sec latency 85.697 ms 20 22954 33.14 MB/sec execute 54 sec latency 91.500 ms 20 23263 32.75 MB/sec execute 55 sec latency 63.700 ms 20 23622 32.54 MB/sec execute 56 sec latency 97.196 ms 20 23964 32.76 MB/sec execute 57 sec latency 110.595 ms 20 24463 33.75 MB/sec execute 58 sec latency 136.340 ms 20 24872 33.99 MB/sec execute 59 sec latency 119.884 ms 20 25210 34.39 MB/sec execute 60 sec latency 113.005 ms 20 25413 33.93 MB/sec execute 61 sec latency 110.897 ms 20 25649 33.52 MB/sec execute 62 sec latency 142.653 ms 20 25831 33.18 MB/sec execute 63 sec latency 193.502 ms 20 26091 33.04 MB/sec execute 64 sec latency 89.165 ms 20 26409 33.08 MB/sec execute 65 sec latency 82.236 ms 20 26726 33.07 MB/sec execute 66 sec latency 72.642 ms 20 27023 32.85 MB/sec execute 67 sec latency 79.211 ms 20 27359 32.75 MB/sec execute 68 sec latency 87.624 ms 20 27667 32.91 MB/sec execute 69 sec latency 145.846 ms 20 28072 33.54 MB/sec execute 70 sec latency 190.774 ms 20 28451 33.75 MB/sec execute 71 sec latency 165.061 ms 20 28748 33.88 MB/sec execute 72 sec latency 114.877 ms 20 28965 33.64 MB/sec execute 73 sec latency 98.564 ms 20 29179 33.26 MB/sec execute 74 sec latency 109.045 ms 20 29383 33.01 MB/sec execute 75 sec latency 137.746 ms 20 29639 32.83 MB/sec execute 76 sec latency 99.528 ms 20 30010 33.02 MB/sec execute 77 sec latency 73.035 ms 20 30326 32.97 MB/sec execute 78 sec latency 84.488 ms 20 30659 32.82 MB/sec execute 79 sec latency 64.945 ms 20 31045 32.87 MB/sec execute 80 sec latency 101.002 ms 20 31415 33.21 MB/sec execute 81 sec latency 152.022 ms 20 31844 33.63 MB/sec execute 82 sec latency 141.882 ms 20 32216 33.90 MB/sec execute 83 sec latency 97.254 ms 20 32465 33.77 MB/sec execute 84 sec latency 135.241 ms 20 32693 33.49 MB/sec execute 85 sec latency 109.157 ms 20 32913 33.22 MB/sec execute 86 sec latency 152.622 ms 20 33154 33.04 MB/sec execute 87 sec latency 96.810 ms 20 33473 33.06 MB/sec execute 88 sec latency 105.766 ms 20 33831 33.19 MB/sec execute 89 sec latency 67.099 ms 20 34140 33.04 MB/sec execute 90 sec latency 72.368 ms 20 34509 33.02 MB/sec execute 91 sec latency 71.899 ms 20 34846 33.15 MB/sec execute 92 sec latency 117.768 ms 20 35268 33.59 MB/sec execute 93 sec latency 122.059 ms 20 35652 33.75 MB/sec execute 94 sec latency 113.838 ms 20 35944 33.83 MB/sec execute 95 sec latency 125.986 ms 20 36154 33.59 MB/sec execute 96 sec latency 92.323 ms 20 36395 33.37 MB/sec execute 97 sec latency 133.086 ms 20 36612 33.18 MB/sec execute 98 sec latency 106.308 ms 20 36886 33.07 MB/sec execute 99 sec latency 104.515 ms 20 37218 33.14 MB/sec execute 100 sec latency 132.892 ms 20 37531 33.18 MB/sec execute 101 sec latency 98.730 ms 20 37822 33.09 MB/sec execute 102 sec latency 92.324 ms 20 38142 33.00 MB/sec execute 103 sec latency 100.479 ms 20 38449 33.11 MB/sec execute 104 sec latency 162.893 ms 20 38793 33.34 MB/sec execute 105 sec latency 129.802 ms 20 39130 33.39 MB/sec execute 106 sec latency 148.536 ms 20 39423 33.53 MB/sec execute 107 sec latency 139.222 ms 20 39645 33.38 MB/sec execute 108 sec latency 87.351 ms 20 39874 33.22 MB/sec execute 109 sec latency 97.969 ms 20 40096 33.01 MB/sec execute 110 sec latency 121.723 ms 20 40315 32.86 MB/sec execute 111 sec latency 125.558 ms 20 40578 32.80 MB/sec execute 112 sec latency 112.859 ms 20 40893 32.85 MB/sec execute 113 sec latency 102.415 ms 20 41205 32.89 MB/sec execute 114 sec latency 98.959 ms 20 41484 32.79 MB/sec execute 115 sec latency 83.465 ms 20 41790 32.75 MB/sec execute 116 sec latency 105.237 ms 20 42084 32.80 MB/sec execute 117 sec latency 133.964 ms 20 42415 32.98 MB/sec execute 118 sec latency 155.138 ms 20 42741 32.99 MB/sec execute 119 sec latency 119.474 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 126325 9.285 51.098 Close 92532 2.183 19.809 Rename 5348 12.221 47.387 Unlink 25706 3.791 31.175 Qpathinfo 114126 2.164 39.188 Qfileinfo 19897 0.067 8.461 Qfsinfo 21349 0.028 4.070 Sfileinfo 10100 6.006 33.095 Find 44597 0.391 29.885 WriteX 62367 0.763 16.182 ReadX 200643 0.012 3.562 LockX 422 2.830 10.796 UnlockX 422 2.755 8.864 Flush 8878 53.904 326.220 Throughput 32.9872 MB/sec 20 clients 20 procs max_latency=326.228 ms stopping dbench on /mnt/lustre/d0.oleg322-client.virtnet at Tue Apr 16 10:52:12 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg322-client.virtnet /mnt/lustre/d0.oleg322-client.virtnet /mnt/lustre/d0.oleg322-client.virtnet removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg322-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 10:52:15 (1713279135) min OST has 3070976kB available, using 4606464kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6897] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4498] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg322-clien 4498M 159676 98 136243 95 381022 85 2496 123 Latency 3210us 34399us 37681us 201ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg322-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 486 15 8811 37 600 10 482 15 1172 12 490 11 Latency 13021us 14231us 224ms 13726us 4953us 13480us 1.97,1.97,oleg322-client.virtnet,1,1713289175,4498M,,,,159676,98,136243,95,,,381022,85,2496,123,10,,,,,486,15,8811,37,600,10,482,15,1172,12,490,11,,3210us,34399us,,37681us,201ms,13021us,14231us,224ms,13726us,4953us,13480us debug=0x33f0484 PASS bonnie (175s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 10:55:12 (1713279312) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 30661 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 30661 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read skipping zero size read truncating to largest ever: 0x733c truncating to largest ever: 0x1231b4 truncating to largest ever: 0x2e1761 truncating to largest ever: 0x37f3d7 truncating to largest ever: 0x3b988c truncating to largest ever: 0x428adc truncating to largest ever: 0x4d4ead truncating to largest ever: 0x535ebe truncating to largest ever: 0x54a210 truncating to largest ever: 0x5574f1 001000 1713279318.320312 read 0x18ce80 thru 0x19b33a (0xe4bb bytes) truncating to largest ever: 0x5596b4 002000 1713279322.563344 read 0x1e9c7f thru 0x1f29a0 (0x8d22 bytes) 003000 1713279327.210621 mapread 0x094170 thru 0x09c739 (0x85ca bytes) truncating to largest ever: 0x55a061 truncating to largest ever: 0x561c15 005000 1713279334.583437 mapread 0x0f28c4 thru 0x0fc027 (0x9764 bytes) 007000 1713279342.876437 trunc from 0x3b81b8 to 0x4c4790 (0x10c5d9 bytes) 008000 1713279346.946013 trunc from 0x41a959 to 0x19bd18 (0x27ec40 bytes) skipping zero size read 014000 1713279374.668911 trunc from 0x4150d0 to 0x27bad5 (0x1995fa bytes) 015000 1713279379.694196 read 0x30bcd5 thru 0x315d6a (0xa096 bytes) 016000 1713279384.806558 mapread 0x0dbfdb thru 0x0e913f (0xd165 bytes) 019000 1713279399.027706 mapwrite 0x18da41 thru 0x199455 (0xba15 bytes) 024000 1713279419.260411 mapwrite 0x1c0a03 thru 0x1c26f6 (0x1cf4 bytes) 025000 1713279424.342941 read 0x17ae00 thru 0x184c52 (0x9e53 bytes) truncating to largest ever: 0x562d93 027000 1713279433.675455 mapwrite 0x3217d3 thru 0x327460 (0x5c8e bytes) 028000 1713279438.858240 read 0x26b8b9 thru 0x27b733 (0xfe7b bytes) 030000 1713279448.140569 mapwrite 0x472271 thru 0x480433 (0xe1c3 bytes) 031000 1713279453.074808 trunc from 0x532f88 to 0x3ea9e0 (0x1485a7 bytes) 032000 1713279457.211451 write 0x1d51cb thru 0x1da06c (0x4ea2 bytes) 033000 1713279462.440345 write 0x4d348b thru 0x4da423 (0x6f99 bytes) 034000 1713279465.657616 mapwrite 0x27b890 thru 0x27dc89 (0x23fa bytes) 036000 1713279475.387512 read 0x1f23e3 thru 0x1f526a (0x2e88 bytes) 037000 1713279479.950921 read 0x0385d4 thru 0x041db5 (0x97e2 bytes) 040000 1713279492.483831 trunc from 0x1a9dfc to 0x0d4a3b (0xd53c0 bytes) 042000 1713279500.824504 mapwrite 0x138d44 thru 0x13d118 (0x43d5 bytes) 043000 1713279504.465914 read 0x1bf4f6 thru 0x1cc18d (0xcc98 bytes) 045000 1713279512.178165 mapread 0x3b7a9f thru 0x3c32ea (0xb84c bytes) 049000 1713279533.309267 read 0x26305e thru 0x26358d (0x530 bytes) 052000 1713279546.099742 write 0x137302 thru 0x13e328 (0x7027 bytes) 054000 1713279553.604381 read 0x00dc9f thru 0x01bb60 (0xdec2 bytes) 057000 1713279566.823661 mapread 0x090694 thru 0x0909c5 (0x332 bytes) 059000 1713279574.570077 mapread 0x238bfe thru 0x242886 (0x9c89 bytes) 060000 1713279578.866411 mapwrite 0x47b6fb thru 0x4880b1 (0xc9b7 bytes) 064000 1713279596.753930 mapwrite 0x133510 thru 0x13681f (0x3310 bytes) 065000 1713279601.341725 trunc from 0x3e17eb to 0x08f194 (0x352656 bytes) 066000 1713279604.996896 trunc from 0x5468c3 to 0x2aa76b (0x29c157 bytes) 068000 1713279612.823036 mapwrite 0x4c54e3 thru 0x4c9c2f (0x474d bytes) 069000 1713279615.979484 mapread 0x341c3a thru 0x345c4f (0x4016 bytes) 072000 1713279627.911095 mapread 0x102013 thru 0x106cbf (0x4cad bytes) 075000 1713279639.102280 write 0x18db24 thru 0x19812b (0xa608 bytes) 076000 1713279642.582887 mapread 0x061e52 thru 0x06251d (0x6cc bytes) 077000 1713279646.338036 trunc from 0x3d9cb6 to 0x0e1c30 (0x2f8085 bytes) 078000 1713279650.355544 trunc from 0x551be6 to 0x0d3318 (0x47e8cd bytes) 083000 1713279672.681129 trunc from 0x4765b2 to 0x2c571b (0x1b0e96 bytes) 084000 1713279676.634863 write 0x3e5d79 thru 0x3f48c2 (0xeb4a bytes) 085000 1713279681.576203 write 0x2dc3f8 thru 0x2de448 (0x2051 bytes) 086000 1713279686.451189 mapread 0x245f8b thru 0x24d50e (0x7584 bytes) 088000 1713279696.101890 read 0x113635 thru 0x11409f (0xa6b bytes) 089000 1713279700.538354 mapread 0x02bba2 thru 0x02e963 (0x2dc2 bytes) 092000 1713279716.009351 read 0x105bab thru 0x1063db (0x831 bytes) 097000 1713279737.964410 write 0x38d690 thru 0x39c048 (0xe9b9 bytes) 098000 1713279741.499309 write 0x38d326 thru 0x39b130 (0xde0b bytes) 100000 1713279751.277987 write 0x063d11 thru 0x06b736 (0x7a26 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (440s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 11:02:34 (1713279754) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713279770.590674 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713279783.208047 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713279788.521756 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713279811.137543 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713279816.300052 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713279836.097048 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713279840.501738 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713279849.418515 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713279859.693044 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713279864.141203 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713279874.866305 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713279881.182126 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713279900.924571 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713279911.405322 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713279927.999661 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713279945.792432 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713279951.344616 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713279974.161090 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713279980.742478 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713279999.162932 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713280005.024132 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713280011.698089 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713280026.736892 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713280036.591625 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713280044.823547 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713280051.010366 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713280106.521287 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713280123.425211 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713280130.155348 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713280135.513409 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713280141.398606 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713280159.894839 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713280165.875127 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713280184.842590 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713280191.598397 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713280208.240439 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713280223.208873 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713280228.457514 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713280243.559364 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713280270.484076 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713280275.671698 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713280287.511532 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713280299.716396 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (552s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1334 sec ===== 11:11:47 (1713280307) === sanity-benchmark: start cleanup 11:11:48 (1713280308) === === sanity-benchmark: finish cleanup 11:11:48 (1713280308) ===