-----============= acceptance-small: sanity-benchmark ============----- Thu Apr 18 04:40:22 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 04:40:26 (1713429626) === oleg349-client.virtnet: executing check_config_client /mnt/lustre oleg349-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg349-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6279800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6279800.idle_timeout=debug disable quota as required oleg349-server: oleg349-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 04:40:34 (1713429634) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 04:40:35 (1713429635) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6938] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg349-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg349-client.virtnet at Thu Apr 18 04:40:36 EDT 2024 waiting for dbench pid 8949 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 127 113.76 MB/sec warmup 1 sec latency 103.857 ms 20 266 100.06 MB/sec warmup 2 sec latency 75.241 ms 20 402 94.79 MB/sec warmup 3 sec latency 78.734 ms 20 587 100.07 MB/sec warmup 4 sec latency 72.350 ms 20 703 84.77 MB/sec warmup 5 sec latency 299.563 ms 20 789 71.50 MB/sec warmup 6 sec latency 146.632 ms 20 891 61.92 MB/sec warmup 7 sec latency 161.746 ms 20 982 54.76 MB/sec warmup 8 sec latency 147.056 ms 20 1175 51.14 MB/sec warmup 9 sec latency 106.081 ms 20 1449 52.03 MB/sec warmup 10 sec latency 59.299 ms 20 1630 47.58 MB/sec warmup 11 sec latency 157.572 ms 20 1821 43.89 MB/sec warmup 12 sec latency 107.563 ms 20 2012 40.80 MB/sec warmup 13 sec latency 91.198 ms 20 2230 38.60 MB/sec warmup 14 sec latency 29.704 ms 20 2425 37.49 MB/sec warmup 15 sec latency 179.156 ms 20 2719 38.61 MB/sec warmup 16 sec latency 135.421 ms 20 3001 39.50 MB/sec warmup 17 sec latency 183.721 ms 20 3309 39.10 MB/sec warmup 18 sec latency 176.570 ms 20 3604 40.55 MB/sec warmup 19 sec latency 120.775 ms 20 3817 39.76 MB/sec warmup 20 sec latency 29.938 ms 20 3945 38.15 MB/sec warmup 21 sec latency 40.046 ms 20 4093 36.44 MB/sec warmup 22 sec latency 33.691 ms 20 4236 35.00 MB/sec warmup 23 sec latency 355.896 ms 20 4397 3.77 MB/sec execute 1 sec latency 186.269 ms 20 4500 4.58 MB/sec execute 2 sec latency 152.036 ms 20 4650 10.42 MB/sec execute 3 sec latency 134.366 ms 20 4823 11.59 MB/sec execute 4 sec latency 41.644 ms 20 5007 18.75 MB/sec execute 5 sec latency 130.828 ms 20 5131 15.94 MB/sec execute 6 sec latency 108.324 ms 20 5245 13.95 MB/sec execute 7 sec latency 126.891 ms 20 5356 12.43 MB/sec execute 8 sec latency 97.434 ms 20 5458 11.23 MB/sec execute 9 sec latency 150.393 ms 20 5609 10.46 MB/sec execute 10 sec latency 156.434 ms 20 5766 10.23 MB/sec execute 11 sec latency 111.693 ms 20 5913 10.74 MB/sec execute 12 sec latency 204.181 ms 20 6019 10.70 MB/sec execute 13 sec latency 186.608 ms 20 6172 11.95 MB/sec execute 14 sec latency 298.357 ms 20 6454 15.60 MB/sec execute 15 sec latency 187.079 ms 20 6690 16.02 MB/sec execute 16 sec latency 189.773 ms 20 6947 17.57 MB/sec execute 17 sec latency 178.782 ms 20 7152 19.14 MB/sec execute 18 sec latency 135.514 ms 20 7282 18.70 MB/sec execute 19 sec latency 57.719 ms 20 7392 18.48 MB/sec execute 20 sec latency 55.845 ms 20 7499 17.83 MB/sec execute 21 sec latency 46.650 ms 20 7583 17.02 MB/sec execute 22 sec latency 69.755 ms 20 7700 16.35 MB/sec execute 23 sec latency 157.270 ms 20 7805 15.83 MB/sec execute 24 sec latency 172.786 ms 20 7884 15.33 MB/sec execute 25 sec latency 139.550 ms 20 7978 14.92 MB/sec execute 26 sec latency 150.262 ms 20 8069 14.63 MB/sec execute 27 sec latency 228.062 ms 20 8199 14.69 MB/sec execute 28 sec latency 165.126 ms 20 8374 14.98 MB/sec execute 29 sec latency 42.048 ms 20 8570 15.88 MB/sec execute 30 sec latency 141.576 ms 20 8688 15.42 MB/sec execute 31 sec latency 148.231 ms 20 8809 15.01 MB/sec execute 32 sec latency 95.433 ms 20 8940 14.62 MB/sec execute 33 sec latency 89.510 ms 20 9073 14.27 MB/sec execute 34 sec latency 107.949 ms 20 9235 13.99 MB/sec execute 35 sec latency 84.411 ms 20 9398 13.99 MB/sec execute 36 sec latency 140.011 ms 20 9543 14.09 MB/sec execute 37 sec latency 206.095 ms 20 9712 14.57 MB/sec execute 38 sec latency 195.164 ms 20 9931 15.35 MB/sec execute 39 sec latency 206.991 ms 20 10153 15.83 MB/sec execute 40 sec latency 208.342 ms 20 10348 15.97 MB/sec execute 41 sec latency 180.883 ms 20 10597 16.70 MB/sec execute 42 sec latency 131.604 ms 20 10780 17.12 MB/sec execute 43 sec latency 75.025 ms 20 10883 16.96 MB/sec execute 44 sec latency 85.512 ms 20 10975 16.74 MB/sec execute 45 sec latency 58.433 ms 20 11056 16.44 MB/sec execute 46 sec latency 54.329 ms 20 11138 16.11 MB/sec execute 47 sec latency 73.917 ms 20 11250 15.81 MB/sec execute 48 sec latency 164.088 ms 20 11362 15.56 MB/sec execute 49 sec latency 189.250 ms 20 11440 15.32 MB/sec execute 50 sec latency 148.691 ms 20 11527 15.11 MB/sec execute 51 sec latency 186.321 ms 20 11634 14.99 MB/sec execute 52 sec latency 148.792 ms 20 11761 14.97 MB/sec execute 53 sec latency 158.751 ms 20 11903 15.03 MB/sec execute 54 sec latency 146.123 ms 20 12074 15.29 MB/sec execute 55 sec latency 106.003 ms 20 12213 15.36 MB/sec execute 56 sec latency 136.142 ms 20 12334 15.12 MB/sec execute 57 sec latency 113.989 ms 20 12468 14.90 MB/sec execute 58 sec latency 102.074 ms 20 12633 14.71 MB/sec execute 59 sec latency 89.063 ms 20 12823 14.60 MB/sec execute 60 sec latency 79.104 ms 20 13019 14.64 MB/sec execute 61 sec latency 130.708 ms 20 13185 14.88 MB/sec execute 62 sec latency 187.791 ms 20 13389 15.25 MB/sec execute 63 sec latency 202.372 ms 20 13642 15.73 MB/sec execute 64 sec latency 140.331 ms 20 13841 15.86 MB/sec execute 65 sec latency 227.294 ms 20 14065 16.09 MB/sec execute 66 sec latency 149.050 ms 20 14297 16.64 MB/sec execute 67 sec latency 123.646 ms 20 14438 16.58 MB/sec execute 68 sec latency 45.062 ms 20 14556 16.48 MB/sec execute 69 sec latency 45.227 ms 20 14666 16.28 MB/sec execute 70 sec latency 104.766 ms 20 14746 16.06 MB/sec execute 71 sec latency 229.133 ms 20 14885 15.88 MB/sec execute 72 sec latency 156.358 ms 20 14966 15.72 MB/sec execute 73 sec latency 164.005 ms 20 15034 15.55 MB/sec execute 74 sec latency 297.642 ms 20 15146 15.47 MB/sec execute 75 sec latency 162.459 ms 20 15281 15.44 MB/sec execute 76 sec latency 159.739 ms 20 15451 15.53 MB/sec execute 77 sec latency 148.433 ms 20 15632 15.73 MB/sec execute 78 sec latency 111.198 ms 20 15774 15.73 MB/sec execute 79 sec latency 127.734 ms 20 15892 15.56 MB/sec execute 80 sec latency 97.598 ms 20 16032 15.40 MB/sec execute 81 sec latency 94.090 ms 20 16168 15.24 MB/sec execute 82 sec latency 90.510 ms 20 16339 15.16 MB/sec execute 83 sec latency 102.784 ms 20 16521 15.16 MB/sec execute 84 sec latency 91.482 ms 20 16716 15.33 MB/sec execute 85 sec latency 152.493 ms 20 16931 15.56 MB/sec execute 86 sec latency 175.825 ms 20 17193 15.99 MB/sec execute 87 sec latency 175.967 ms 20 17394 16.11 MB/sec execute 88 sec latency 195.662 ms 20 17647 16.35 MB/sec execute 89 sec latency 146.940 ms 20 17879 16.65 MB/sec execute 90 sec latency 84.522 ms 20 18044 16.67 MB/sec execute 91 sec latency 37.902 ms 20 18184 16.54 MB/sec execute 92 sec latency 81.449 ms 20 18288 16.37 MB/sec execute 93 sec latency 270.334 ms 20 18457 16.25 MB/sec execute 94 sec latency 136.993 ms 20 18575 16.13 MB/sec execute 95 sec latency 116.437 ms 20 18735 16.08 MB/sec execute 96 sec latency 115.686 ms 20 18939 16.23 MB/sec execute 97 sec latency 104.262 ms 20 19148 16.33 MB/sec execute 98 sec latency 148.611 ms 20 19355 16.42 MB/sec execute 99 sec latency 112.813 ms 20 19499 16.28 MB/sec execute 100 sec latency 98.234 ms 20 19645 16.15 MB/sec execute 101 sec latency 78.935 ms 20 19837 16.04 MB/sec execute 102 sec latency 74.038 ms 20 20016 15.97 MB/sec execute 103 sec latency 91.245 ms 20 20205 16.03 MB/sec execute 104 sec latency 194.864 ms 20 20409 16.20 MB/sec execute 105 sec latency 136.356 ms 20 20757 16.69 MB/sec execute 106 sec latency 131.740 ms 20 21054 16.92 MB/sec execute 107 sec latency 144.562 ms 20 21302 17.15 MB/sec execute 108 sec latency 118.773 ms 20 21496 17.30 MB/sec execute 109 sec latency 36.069 ms 20 21647 17.28 MB/sec execute 110 sec latency 39.168 ms 20 21801 17.17 MB/sec execute 111 sec latency 67.374 ms 20 21933 17.03 MB/sec execute 112 sec latency 325.998 ms 20 22073 16.92 MB/sec execute 113 sec latency 264.491 ms 20 22192 16.83 MB/sec execute 114 sec latency 123.087 ms 20 22358 16.79 MB/sec execute 115 sec latency 109.686 ms 20 22593 16.93 MB/sec execute 116 sec latency 116.318 ms 20 22828 17.15 MB/sec execute 117 sec latency 94.301 ms 20 22987 17.03 MB/sec execute 118 sec latency 139.270 ms 20 23163 16.91 MB/sec execute 119 sec latency 92.663 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 66559 18.527 85.495 Close 49353 4.941 26.063 Rename 2796 23.862 76.277 Unlink 12876 6.941 38.640 Qpathinfo 59987 4.042 70.804 Qfileinfo 10485 0.119 15.797 Qfsinfo 10668 0.053 9.238 Sfileinfo 5584 12.374 43.082 Find 22948 0.628 48.490 WriteX 32604 1.486 26.449 ReadX 102190 0.018 5.025 LockX 200 5.752 18.450 UnlockX 200 5.755 20.038 Flush 4696 81.758 325.991 Throughput 16.9134 MB/sec 20 clients 20 procs max_latency=325.998 ms stopping dbench on /mnt/lustre/d0.oleg349-client.virtnet at Thu Apr 18 04:43:01 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg349-client.virtnet /mnt/lustre/d0.oleg349-client.virtnet /mnt/lustre/d0.oleg349-client.virtnet removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg349-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 04:43:06 (1713429786) min OST has 3156992kB available, using 4735488kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6938] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4624] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg349-clien 4624M 142560 96 133893 93 396622 76 1495 143 Latency 4081us 33510us 29558us 190ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg349-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 286 17 6584 26 430 12 360 17 1270 12 598 11 Latency 15151us 18029us 54308us 15537us 3001us 11658us 1.97,1.97,oleg349-client.virtnet,1,1713437322,4624M,,,,142560,96,133893,93,,,396622,76,1495,143,10,,,,,286,17,6584,26,430,12,360,17,1270,12,598,11,,4081us,33510us,,29558us,190ms,15151us,18029us,54308us,15537us,3001us,11658us debug=0x33f0484 PASS bonnie (208s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 04:46:36 (1713429996) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 10285 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 10285 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x344bd0 truncating to largest ever: 0x48f1ff truncating to largest ever: 0x4a5324 truncating to largest ever: 0x505ef7 truncating to largest ever: 0x52aeba truncating to largest ever: 0x54e25c truncating to largest ever: 0x557602 truncating to largest ever: 0x55b433 truncating to largest ever: 0x55d696 006000 1713430017.084812 mapwrite 0x271e75 thru 0x279eee (0x807a bytes) truncating to largest ever: 0x55dc56 truncating to largest ever: 0x55f456 truncating to largest ever: 0x5620f3 010000 1713430030.272915 read 0x108226 thru 0x110db9 (0x8b94 bytes) 012000 1713430035.462837 write 0x327d0d thru 0x3288b7 (0xbab bytes) truncating to largest ever: 0x562378 013000 1713430038.524581 write 0x473004 thru 0x476137 (0x3134 bytes) 014000 1713430042.015896 mapread 0x3fc015 thru 0x408254 (0xc240 bytes) 015000 1713430045.791343 mapread 0x2f656f thru 0x2febc3 (0x8655 bytes) 016000 1713430049.634679 trunc from 0x44b63f to 0x2fb31f (0x15031f bytes) 017000 1713430053.284289 mapread 0x3d17f0 thru 0x3e09ab (0xf1bc bytes) 018000 1713430056.298246 mapwrite 0x450820 thru 0x45572c (0x4f0d bytes) 019000 1713430060.216196 write 0x11ccd3 thru 0x126d71 (0xa09f bytes) 020000 1713430063.367076 mapwrite 0x258f69 thru 0x25b33a (0x23d2 bytes) 021000 1713430066.897314 write 0x045e37 thru 0x0481c2 (0x238c bytes) 022000 1713430069.995671 mapwrite 0x07be6b thru 0x08b50d (0xf6a3 bytes) 023000 1713430072.989311 write 0x17d4c2 thru 0x18c189 (0xecc8 bytes) skipping zero size write 024000 1713430075.926394 write 0x115543 thru 0x11bb9e (0x665c bytes) 025000 1713430078.586270 trunc from 0x018c4f to 0x4171c0 (0x3fe572 bytes) 028000 1713430088.715668 mapread 0x4b1b25 thru 0x4bc4e2 (0xa9be bytes) 030000 1713430095.489973 write 0x3a2238 thru 0x3a38c6 (0x168f bytes) 031000 1713430098.818263 trunc from 0x562e00 to 0x0a5f1e (0x4bcee1 bytes) 032000 1713430101.773080 read 0x18ee3a thru 0x195962 (0x6b29 bytes) 034000 1713430108.788947 mapwrite 0x21240e thru 0x21f4bb (0xd0ae bytes) 036000 1713430116.293253 mapread 0x472de6 thru 0x473c63 (0xe7e bytes) 038000 1713430124.147106 read 0x44be60 thru 0x45bdf8 (0xff99 bytes) 040000 1713430133.718969 write 0x37cc46 thru 0x38a33e (0xd6f9 bytes) 044000 1713430149.561949 mapread 0x25b3ea thru 0x262dc8 (0x79df bytes) 045000 1713430152.916488 mapwrite 0x28e65f thru 0x29a795 (0xc137 bytes) 048000 1713430164.380324 trunc from 0x4eb2d6 to 0x3a352d (0x147da8 bytes) 049000 1713430167.798211 mapread 0x374f27 thru 0x37b65e (0x6738 bytes) 051000 1713430175.192192 mapwrite 0x53c964 thru 0x5480ba (0xb757 bytes) truncating to largest ever: 0x562cb0 052000 1713430179.451082 read 0x027044 thru 0x02f731 (0x86ee bytes) 053000 1713430182.771706 read 0x3a4ee4 thru 0x3b041e (0xb53b bytes) 056000 1713430195.072951 mapwrite 0x0b99c3 thru 0x0bed0d (0x534b bytes) 057000 1713430198.600680 read 0x32776a thru 0x3309f7 (0x928e bytes) 058000 1713430201.912180 trunc from 0x2086a9 to 0x3521a5 (0x149afd bytes) 060000 1713430209.463499 trunc from 0x43c58e to 0x1855d7 (0x2b6fb6 bytes) 061000 1713430213.089046 mapwrite 0x125e35 thru 0x12830e (0x24da bytes) 062000 1713430216.712429 read 0x022928 thru 0x026756 (0x3e2f bytes) 063000 1713430219.933051 mapread 0x1fc911 thru 0x1ff92d (0x301d bytes) 064000 1713430223.305577 trunc from 0x0d41a7 to 0x38cb6c (0x2b89c6 bytes) 065000 1713430226.078170 mapread 0x0e1469 thru 0x0eb41f (0x9fb7 bytes) 067000 1713430231.360785 trunc from 0x0b54ba to 0x3baa54 (0x30559b bytes) 070000 1713430242.502913 mapwrite 0x4a5d5e thru 0x4b5b51 (0xfdf4 bytes) 072000 1713430249.962211 trunc from 0x1ffb87 to 0x223b2a (0x23fa4 bytes) 074000 1713430257.782223 write 0x4f5b3d thru 0x50115c (0xb620 bytes) 075000 1713430261.921328 trunc from 0x4ee771 to 0x1d9132 (0x31563e bytes) 076000 1713430265.620718 mapwrite 0x004397 thru 0x00bcca (0x7934 bytes) 077000 1713430270.512368 write 0x3bbb9a thru 0x3c5586 (0x99ed bytes) 080000 1713430282.928898 trunc from 0x4e90bf to 0x195f69 (0x353155 bytes) 081000 1713430286.606852 read 0x0f4a30 thru 0x0f95af (0x4b80 bytes) 082000 1713430289.821653 mapread 0x02ae5b thru 0x0363be (0xb564 bytes) 083000 1713430293.397760 mapread 0x31b32c thru 0x31d300 (0x1fd5 bytes) 085000 1713430300.778096 mapread 0x374e03 thru 0x37b096 (0x6294 bytes) 089000 1713430314.161681 write 0x265e79 thru 0x26e505 (0x868d bytes) 091000 1713430319.715703 write 0x3834e2 thru 0x392bb4 (0xf6d3 bytes) 093000 1713430326.859655 trunc from 0x475b99 to 0x2db7d1 (0x19a3c7 bytes) 095000 1713430333.435922 trunc from 0x49d10c to 0x139845 (0x3638c6 bytes) 097000 1713430340.292496 mapread 0x24e7cd thru 0x25ad99 (0xc5cd bytes) 098000 1713430343.051962 write 0x33f4b3 thru 0x34b93e (0xc48c bytes) 099000 1713430345.866016 read 0x4d3d04 thru 0x4e0914 (0xcc11 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (353s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 04:52:31 (1713430351) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713430359.970612 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713430367.183873 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713430370.612923 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713430384.697025 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713430387.854333 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713430399.917222 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713430402.893544 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713430409.415114 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713430416.684262 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713430420.019512 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713430425.911699 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713430429.055151 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713430440.617147 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713430445.918651 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713430454.619843 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713430463.306086 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713430465.932484 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713430479.022287 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713430482.829389 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713430493.218130 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713430496.449011 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713430500.356237 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713430509.777855 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713430515.909446 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713430522.317937 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713430525.727813 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713430558.883389 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713430568.640556 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713430572.504240 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713430575.635931 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713430578.927658 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713430589.855643 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713430593.269206 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713430604.368089 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713430608.396563 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713430618.500448 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713430628.935424 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713430632.213425 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713430641.463525 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713430657.955890 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713430660.910491 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713430667.663048 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713430674.796513 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (327s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1057 sec ===== 04:57:59 (1713430679) === sanity-benchmark: start cleanup 04:57:59 (1713430679) === === sanity-benchmark: finish cleanup 04:57:59 (1713430679) ===