-----============= acceptance-small: sanity-benchmark ============----- Wed Apr 17 10:29:54 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 10:29:58 (1713364198) === oleg403-client.virtnet: executing check_config_client /mnt/lustre oleg403-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg403-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6136000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6136000.idle_timeout=debug disable quota as required oleg403-server: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 10:30:05 (1713364205) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 10:30:06 (1713364206) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7502] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg403-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg403-client.virtnet at Wed Apr 17 10:30:07 EDT 2024 waiting for dbench pid 9721 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 295 217.82 MB/sec warmup 1 sec latency 47.519 ms 20 673 210.40 MB/sec warmup 2 sec latency 31.857 ms 20 1021 148.88 MB/sec warmup 3 sec latency 20.500 ms 20 1487 130.20 MB/sec warmup 4 sec latency 28.432 ms 20 1896 105.56 MB/sec warmup 5 sec latency 18.684 ms 20 2374 92.94 MB/sec warmup 6 sec latency 15.885 ms 20 2772 91.15 MB/sec warmup 7 sec latency 324.633 ms 20 3392 90.02 MB/sec warmup 8 sec latency 565.477 ms 20 3850 88.37 MB/sec warmup 9 sec latency 20.235 ms 20 4135 80.21 MB/sec warmup 10 sec latency 33.878 ms 20 4447 74.11 MB/sec warmup 11 sec latency 44.552 ms 20 4863 71.71 MB/sec warmup 12 sec latency 24.125 ms 20 5276 69.77 MB/sec warmup 13 sec latency 30.909 ms 20 5717 65.59 MB/sec warmup 14 sec latency 23.515 ms 20 6194 65.25 MB/sec warmup 15 sec latency 22.494 ms 20 6931 68.88 MB/sec warmup 16 sec latency 23.912 ms 20 7380 69.33 MB/sec warmup 17 sec latency 20.429 ms 20 7668 65.83 MB/sec warmup 18 sec latency 35.263 ms 20 8002 63.05 MB/sec warmup 19 sec latency 28.987 ms 20 8398 62.33 MB/sec warmup 20 sec latency 22.172 ms 20 8802 61.39 MB/sec warmup 21 sec latency 21.190 ms 20 9208 58.98 MB/sec warmup 22 sec latency 19.256 ms 20 9655 58.72 MB/sec warmup 23 sec latency 17.904 ms 20 10894 79.77 MB/sec execute 1 sec latency 24.068 ms 20 11179 44.18 MB/sec execute 2 sec latency 48.690 ms 20 11475 32.83 MB/sec execute 3 sec latency 33.697 ms 20 11818 32.65 MB/sec execute 4 sec latency 36.544 ms 20 12238 38.26 MB/sec execute 5 sec latency 24.202 ms 20 12589 32.95 MB/sec execute 6 sec latency 23.983 ms 20 13045 32.73 MB/sec execute 7 sec latency 19.838 ms 20 13622 41.48 MB/sec execute 8 sec latency 31.074 ms 20 14243 48.44 MB/sec execute 9 sec latency 22.846 ms 20 14548 46.73 MB/sec execute 10 sec latency 23.673 ms 20 14803 42.93 MB/sec execute 11 sec latency 42.904 ms 20 15114 40.59 MB/sec execute 12 sec latency 25.875 ms 20 15419 39.98 MB/sec execute 13 sec latency 36.107 ms 20 15817 41.03 MB/sec execute 14 sec latency 26.715 ms 20 16201 38.77 MB/sec execute 15 sec latency 20.781 ms 20 16622 38.46 MB/sec execute 16 sec latency 18.039 ms 20 17164 42.16 MB/sec execute 17 sec latency 30.332 ms 20 17786 45.58 MB/sec execute 18 sec latency 23.312 ms 20 18103 44.76 MB/sec execute 19 sec latency 22.835 ms 20 18372 42.76 MB/sec execute 20 sec latency 35.467 ms 20 18689 41.46 MB/sec execute 21 sec latency 28.014 ms 20 19103 42.29 MB/sec execute 22 sec latency 33.778 ms 20 19460 41.66 MB/sec execute 23 sec latency 27.871 ms 20 19847 40.26 MB/sec execute 24 sec latency 18.825 ms 20 20261 40.18 MB/sec execute 25 sec latency 19.804 ms 20 20892 42.98 MB/sec execute 26 sec latency 23.991 ms 20 21487 45.05 MB/sec execute 27 sec latency 19.338 ms 20 21795 44.14 MB/sec execute 28 sec latency 21.462 ms 20 22059 42.85 MB/sec execute 29 sec latency 43.280 ms 20 22409 42.35 MB/sec execute 30 sec latency 20.674 ms 20 22831 43.08 MB/sec execute 31 sec latency 24.218 ms 20 23188 42.01 MB/sec execute 32 sec latency 20.347 ms 20 23653 41.49 MB/sec execute 33 sec latency 18.605 ms 20 24189 42.99 MB/sec execute 34 sec latency 21.868 ms 20 24852 44.91 MB/sec execute 35 sec latency 28.163 ms 20 25202 44.86 MB/sec execute 36 sec latency 21.810 ms 20 25469 43.79 MB/sec execute 37 sec latency 55.967 ms 20 25810 43.10 MB/sec execute 38 sec latency 25.683 ms 20 26213 43.35 MB/sec execute 39 sec latency 29.309 ms 20 26592 43.11 MB/sec execute 40 sec latency 22.820 ms 20 26991 42.30 MB/sec execute 41 sec latency 24.203 ms 20 27423 42.48 MB/sec execute 42 sec latency 20.705 ms 20 28056 44.04 MB/sec execute 43 sec latency 59.107 ms 20 28576 45.05 MB/sec execute 44 sec latency 25.529 ms 20 28862 44.45 MB/sec execute 45 sec latency 22.985 ms 20 29165 43.65 MB/sec execute 46 sec latency 47.272 ms 20 29526 43.37 MB/sec execute 47 sec latency 32.011 ms 20 29964 43.83 MB/sec execute 48 sec latency 21.377 ms 20 30345 43.07 MB/sec execute 49 sec latency 24.318 ms 20 30814 42.85 MB/sec execute 50 sec latency 19.583 ms 20 31388 43.97 MB/sec execute 51 sec latency 23.798 ms 20 32017 45.23 MB/sec execute 52 sec latency 27.102 ms 20 32337 44.92 MB/sec execute 53 sec latency 25.437 ms 20 32645 44.21 MB/sec execute 54 sec latency 35.760 ms 20 32981 43.80 MB/sec execute 55 sec latency 30.926 ms 20 33433 44.22 MB/sec execute 56 sec latency 23.694 ms 20 33799 43.70 MB/sec execute 57 sec latency 28.651 ms 20 34253 43.32 MB/sec execute 58 sec latency 19.543 ms 20 34775 44.02 MB/sec execute 59 sec latency 23.257 ms 20 35487 45.23 MB/sec execute 60 sec latency 23.810 ms 20 35856 45.28 MB/sec execute 61 sec latency 20.502 ms 20 36139 44.65 MB/sec execute 62 sec latency 50.339 ms 20 36482 44.28 MB/sec execute 63 sec latency 25.797 ms 20 36889 44.41 MB/sec execute 64 sec latency 21.008 ms 20 37270 44.19 MB/sec execute 65 sec latency 24.455 ms 20 37732 43.79 MB/sec execute 66 sec latency 19.748 ms 20 38227 44.21 MB/sec execute 67 sec latency 25.685 ms 20 38921 45.26 MB/sec execute 68 sec latency 24.705 ms 20 39342 45.53 MB/sec execute 69 sec latency 21.358 ms 20 39615 44.99 MB/sec execute 70 sec latency 40.109 ms 20 39972 44.60 MB/sec execute 71 sec latency 24.565 ms 20 40377 44.64 MB/sec execute 72 sec latency 26.003 ms 20 40762 44.57 MB/sec execute 73 sec latency 23.415 ms 20 41164 44.11 MB/sec execute 74 sec latency 21.086 ms 20 41609 44.17 MB/sec execute 75 sec latency 19.565 ms 20 42270 45.11 MB/sec execute 76 sec latency 22.093 ms 20 42806 45.66 MB/sec execute 77 sec latency 21.038 ms 20 43083 45.26 MB/sec execute 78 sec latency 45.441 ms 20 43398 44.81 MB/sec execute 79 sec latency 42.990 ms 20 43782 44.76 MB/sec execute 80 sec latency 21.254 ms 20 44201 44.84 MB/sec execute 81 sec latency 25.487 ms 20 44605 44.41 MB/sec execute 82 sec latency 22.959 ms 20 45099 44.45 MB/sec execute 83 sec latency 24.552 ms 20 45764 45.29 MB/sec execute 84 sec latency 27.480 ms 20 46338 45.83 MB/sec execute 85 sec latency 27.010 ms 20 46620 45.49 MB/sec execute 86 sec latency 49.847 ms 20 46944 45.08 MB/sec execute 87 sec latency 51.238 ms 20 47305 45.00 MB/sec execute 88 sec latency 27.759 ms 20 47719 45.09 MB/sec execute 89 sec latency 22.038 ms 20 48099 44.70 MB/sec execute 90 sec latency 25.294 ms 20 48558 44.58 MB/sec execute 91 sec latency 22.518 ms 20 49161 45.25 MB/sec execute 92 sec latency 19.313 ms 20 49766 45.84 MB/sec execute 93 sec latency 20.505 ms 20 50080 45.67 MB/sec execute 94 sec latency 21.784 ms 20 50360 45.26 MB/sec execute 95 sec latency 46.424 ms 20 50665 44.97 MB/sec execute 96 sec latency 27.438 ms 20 51050 45.08 MB/sec execute 97 sec latency 31.362 ms 20 51399 44.90 MB/sec execute 98 sec latency 23.337 ms 20 51791 44.56 MB/sec execute 99 sec latency 23.631 ms 20 52204 44.56 MB/sec execute 100 sec latency 22.154 ms 20 52802 45.14 MB/sec execute 101 sec latency 23.544 ms 20 53340 45.59 MB/sec execute 102 sec latency 26.349 ms 20 53653 45.40 MB/sec execute 103 sec latency 30.902 ms 20 53932 45.03 MB/sec execute 104 sec latency 41.948 ms 20 54260 44.79 MB/sec execute 105 sec latency 22.102 ms 20 54673 44.95 MB/sec execute 106 sec latency 23.176 ms 20 55014 44.71 MB/sec execute 107 sec latency 23.249 ms 20 55413 44.45 MB/sec execute 108 sec latency 24.338 ms 20 55895 44.64 MB/sec execute 109 sec latency 22.040 ms 20 56545 45.21 MB/sec execute 110 sec latency 25.555 ms 20 56982 45.42 MB/sec execute 111 sec latency 25.456 ms 20 57259 45.18 MB/sec execute 112 sec latency 37.798 ms 20 57554 44.85 MB/sec execute 113 sec latency 30.372 ms 20 57902 44.75 MB/sec execute 114 sec latency 23.073 ms 20 58317 44.84 MB/sec execute 115 sec latency 21.136 ms 20 58667 44.56 MB/sec execute 116 sec latency 31.461 ms 20 59095 44.39 MB/sec execute 117 sec latency 17.843 ms 20 59617 44.70 MB/sec execute 118 sec latency 25.195 ms 20 60225 45.23 MB/sec execute 119 sec latency 32.548 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 173992 7.932 55.959 Close 127657 1.922 29.167 Rename 7361 10.576 34.312 Unlink 35205 2.862 24.139 Qpathinfo 157242 1.902 38.823 Qfileinfo 27303 0.069 7.054 Qfsinfo 29113 0.030 4.687 Sfileinfo 14000 6.355 36.239 Find 60955 0.405 44.465 WriteX 85709 0.941 20.100 ReadX 272561 0.014 4.759 LockX 560 2.077 6.537 UnlockX 560 2.194 7.375 Flush 12087 7.164 59.102 Throughput 45.2256 MB/sec 20 clients 20 procs max_latency=59.107 ms stopping dbench on /mnt/lustre/d0.oleg403-client.virtnet at Wed Apr 17 10:32:31 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg403-client.virtnet /mnt/lustre/d0.oleg403-client.virtnet /mnt/lustre/d0.oleg403-client.virtnet removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg403-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (148s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 10:32:35 (1713364355) min OST has 3463120kB available, using 5194680kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7502] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s5072] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg403-clien 5072M 168677 98 143647 93 384501 82 6021 304 Latency 3558us 50892us 29788us 3661us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg403-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 314 16 8083 36 609 12 377 17 1341 12 702 12 Latency 35707us 13752us 19573us 22601us 4130us 26732us 1.97,1.97,oleg403-client.virtnet,1,1713370902,5072M,,,,168677,98,143647,93,,,384501,82,6021,304,10,,,,,314,16,8083,36,609,12,377,17,1341,12,702,12,,3558us,50892us,,29788us,3661us,35707us,13752us,19573us,22601us,4130us,26732us debug=0x33f0484 PASS bonnie (188s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 10:35:46 (1713364546) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 633 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 633 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read fallocating to largest ever: 0x3198f9 fallocating to largest ever: 0x486f82 truncating to largest ever: 0x4996c4 fallocating to largest ever: 0x509694 truncating to largest ever: 0x50e82c fallocating to largest ever: 0x51bfeb truncating to largest ever: 0x525890 001000 1713364551.301855 punch from 0x05481b to 0x060018 (0xb7fe bytes) fallocating to largest ever: 0x5285f4 002000 1713364555.360457 read 0x018ae3 thru 0x01e610 (0x5b2e bytes) 003000 1713364559.264128 trunc from 0x2e04e2 to 0x1acf88 (0x133559 bytes) 004000 1713364563.230057 fallocate 0x35bb35 thru 0x36b445 (0xf911 bytes) 005000 1713364567.271811 write 0x3c2fc6 thru 0x3c8081 (0x50bc bytes) 006000 1713364570.549532 read 0x0452da thru 0x04eba0 (0x98c7 bytes) 009000 1713364577.837908 trunc from 0x44d4bb to 0x3b4e18 (0x986a2 bytes) 010000 1713364580.885859 read 0x1583ca thru 0x1608d9 (0x8510 bytes) 014000 1713364594.467994 trunc from 0x3ccbd4 to 0x238eb4 (0x193d1f bytes) 016000 1713364600.986101 read 0x01f808 thru 0x0264f5 (0x6cee bytes) 017000 1713364604.694925 mapread 0x0ca4bd thru 0x0cac93 (0x7d7 bytes) 020000 1713364616.560059 mapwrite 0x118398 thru 0x1210e4 (0x8d4d bytes) 021000 1713364619.858009 mapread 0x378aa1 thru 0x386eeb (0xe44b bytes) skipping zero length fallocate 022000 1713364624.143317 mapwrite 0x40df0b thru 0x41804e (0xa144 bytes) 024000 1713364631.921702 write 0x4b66b9 thru 0x4bb336 (0x4c7e bytes) 025000 1713364635.744719 read 0x0108c4 thru 0x01d0b4 (0xc7f1 bytes) 027000 1713364644.084782 mapwrite 0x3a5f77 thru 0x3ac9c5 (0x6a4f bytes) 028000 1713364647.931259 trunc from 0x10719a to 0x154012 (0x4ce79 bytes) 029000 1713364651.936623 trunc from 0x4e2ce9 to 0x205b93 (0x2dd155 bytes) 030000 1713364655.932696 fallocate 0x21c156 thru 0x22be73 (0xfd1e bytes) 031000 1713364659.171813 mapread 0x2f1e6d thru 0x2fb5f2 (0x9786 bytes) 032000 1713364662.258020 trunc from 0x40e35c to 0x13fc11 (0x2ce74a bytes) 033000 1713364665.053071 mapread 0x18d60c thru 0x1968f6 (0x92eb bytes) 034000 1713364668.617098 mapwrite 0x34a64a thru 0x357358 (0xcd0f bytes) 036000 1713364674.784183 fallocate 0x2f6ee5 thru 0x2f77b0 (0x8cc bytes) 037000 1713364678.353605 punch from 0x2bd31d to 0x2c0097 (0x2d7b bytes) 038000 1713364681.638695 mapread 0x2ce022 thru 0x2cfb58 (0x1b37 bytes) 039000 1713364685.492729 trunc from 0x3e9830 to 0x0c82f5 (0x32153a bytes) 040000 1713364689.051412 trunc from 0x3132f4 to 0x133941 (0x1df9b2 bytes) 041000 1713364691.657320 mapread 0x2a0b1b thru 0x2a602b (0x5511 bytes) 043000 1713364697.861135 write 0x0437a1 thru 0x04b8ad (0x810d bytes) 044000 1713364700.986530 write 0x16af1d thru 0x17a58a (0xf66e bytes) 045000 1713364703.639532 punch from 0x3979df to 0x39ca35 (0x5057 bytes) 046000 1713364706.839728 read 0x24498b thru 0x245459 (0xacf bytes) 047000 1713364709.945832 read 0x308df5 thru 0x31481b (0xba27 bytes) 049000 1713364715.756883 mapwrite 0x52176d thru 0x5285f3 (0x6e87 bytes) 050000 1713364718.649373 read 0x23b43c thru 0x2425a1 (0x7166 bytes) 051000 1713364721.859798 mapread 0x10e34f thru 0x11e0c1 (0xfd73 bytes) 053000 1713364727.811115 write 0x089175 thru 0x08e007 (0x4e93 bytes) 057000 1713364737.977283 trunc from 0x4c7526 to 0x436a06 (0x90b1f bytes) 058000 1713364740.154743 trunc from 0x333e69 to 0x4d8e8c (0x1a5024 bytes) 059000 1713364742.280375 mapread 0x22e066 thru 0x23a627 (0xc5c2 bytes) 062000 1713364748.280707 punch from 0x063aef to 0x0714da (0xd9ec bytes) 063000 1713364750.175090 mapread 0x17c1a5 thru 0x1866e2 (0xa53e bytes) 064000 1713364752.202558 write 0x325df5 thru 0x32d6a4 (0x78b0 bytes) 066000 1713364756.249501 mapread 0x300728 thru 0x30a4c2 (0x9d9b bytes) 067000 1713364758.596463 write 0x07a67d thru 0x08403a (0x99be bytes) 068000 1713364760.697877 trunc from 0x4dfe81 to 0x434496 (0xab9ea bytes) 070000 1713364765.268685 punch from 0x1c164a to 0x1c7a30 (0x63e7 bytes) 071000 1713364767.774780 write 0x34fd82 thru 0x353729 (0x39a8 bytes) 072000 1713364770.263737 trunc from 0x470dd1 to 0x3eb0dd (0x85cf3 bytes) 073000 1713364772.747469 trunc from 0x41f678 to 0x2a5731 (0x179f46 bytes) 074000 1713364774.875388 trunc from 0x392b8a to 0x18eed6 (0x203cb3 bytes) 075000 1713364776.807179 write 0x4b373d thru 0x4b41b8 (0xa7c bytes) 077000 1713364781.333117 fallocate 0x3a91df thru 0x3acc0d (0x3a2f bytes) 078000 1713364783.796818 mapwrite 0x151f2f thru 0x157cf9 (0x5dcb bytes) 079000 1713364785.815723 punch from 0x0a0687 to 0x0ae364 (0xdcde bytes) 080000 1713364788.171761 read 0x02846f thru 0x035562 (0xd0f4 bytes) 082000 1713364793.102817 fallocate 0x06dfb9 thru 0x07756f (0x95b7 bytes) 084000 1713364797.952450 write 0x3d0328 thru 0x3d43e3 (0x40bc bytes) 085000 1713364800.518215 mapread 0x16ad79 thru 0x17963a (0xe8c2 bytes) 086000 1713364802.704069 read 0x170794 thru 0x171467 (0xcd4 bytes) 087000 1713364804.574848 trunc from 0x4ee8a3 to 0x03e340 (0x4b0562 bytes) 088000 1713364806.644210 trunc from 0x45a706 to 0x32423d (0x1364c8 bytes) 089000 1713364808.537517 trunc from 0x460f05 to 0x4f8384 (0x97480 bytes) 091000 1713364812.984465 write 0x1a5ba0 thru 0x1afd86 (0xa1e7 bytes) 093000 1713364817.342408 write 0x3bf5a5 thru 0x3ce28b (0xece7 bytes) 094000 1713364819.498106 mapread 0x0242c1 thru 0x02a74f (0x648f bytes) 095000 1713364821.654189 fallocate 0x095c2c thru 0x09625a (0x62f bytes) 096000 1713364823.495654 mapread 0x0003c3 thru 0x00e013 (0xdc51 bytes) 099000 1713364829.382051 read 0x00a064 thru 0x00cb75 (0x2b12 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (286s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 10:40:33 (1713364833) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1713364836.281103 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1713364839.008037 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1713364841.829664 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1713364844.872751 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1713364850.470448 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1713364852.706779 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1713364855.806068 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1713364858.518600 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1713364861.408117 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1713364863.751824 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1713364866.304362 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1713364868.918059 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1713364871.282028 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1713364873.793554 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1713364876.135024 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1713364878.207366 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1713364880.452479 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1713364882.786310 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1713364884.968481 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1713364892.351516 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1713364895.073906 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1713364897.721833 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1713364900.207047 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1713364905.168630 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1713364910.047491 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1713364912.666803 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1713364915.359081 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1713364921.669113 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1713364924.794209 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1713364928.967309 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1713364931.274447 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1713364933.423548 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1713364935.850287 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1713364938.455086 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1713364943.473108 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1713364951.176471 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1713364959.489318 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1713364965.339826 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1713364968.209706 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1713364971.070709 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1713364978.177192 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1713364980.729972 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1713364983.422282 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1713364986.125416 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1713364988.788364 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1713364991.201252 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1713364993.751069 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1713364996.378824 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1713364999.538868 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1713365003.964434 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1713365006.553074 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1713365008.741809 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1713365010.965536 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1713365013.401244 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1713365018.343229 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1713365026.157179 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1713365031.673908 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1713365034.449354 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1713365037.000464 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1713365042.226906 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1713365044.780908 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1713365049.562862 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1713365052.141604 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1713365057.080738 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1713365062.030527 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1713365067.528220 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1713365070.158464 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1713365072.436971 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1713365074.589505 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1713365079.568209 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1713365082.066310 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1713365087.415433 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1713365090.232269 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (258s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 896 sec ====== 10:44:51 (1713365091) === sanity-benchmark: start cleanup 10:44:52 (1713365092) === === sanity-benchmark: finish cleanup 10:44:52 (1713365092) ===