-----============= acceptance-small: sanity-benchmark ============----- Tue Apr 16 15:40:46 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 15:40:50 (1713296450) === oleg115-client.virtnet: executing check_config_client /mnt/lustre oleg115-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg115-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aa470800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aa470800.idle_timeout=debug disable quota as required oleg115-server: oleg115-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 15:40:57 (1713296457) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 15:40:58 (1713296458) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7503] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg115-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg115-client.virtnet at Tue Apr 16 15:40:58 EDT 2024 waiting for dbench pid 9721 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 263 198.57 MB/sec warmup 1 sec latency 52.223 ms 20 566 195.59 MB/sec warmup 2 sec latency 42.663 ms 20 901 144.74 MB/sec warmup 3 sec latency 35.331 ms 20 1234 115.36 MB/sec warmup 4 sec latency 22.118 ms 20 1643 104.75 MB/sec warmup 5 sec latency 37.248 ms 20 2048 88.61 MB/sec warmup 6 sec latency 22.495 ms 20 2450 80.83 MB/sec warmup 7 sec latency 19.941 ms 20 3009 83.98 MB/sec warmup 8 sec latency 28.367 ms 20 3650 85.88 MB/sec warmup 9 sec latency 28.016 ms 20 3983 80.12 MB/sec warmup 10 sec latency 22.102 ms 20 4284 73.38 MB/sec warmup 11 sec latency 46.072 ms 20 4647 69.99 MB/sec warmup 12 sec latency 21.039 ms 20 5117 69.57 MB/sec warmup 13 sec latency 23.582 ms 20 5482 65.05 MB/sec warmup 14 sec latency 30.005 ms 20 5961 62.83 MB/sec warmup 15 sec latency 18.182 ms 20 6549 65.73 MB/sec warmup 16 sec latency 23.414 ms 20 7231 68.25 MB/sec warmup 17 sec latency 21.326 ms 20 7542 65.75 MB/sec warmup 18 sec latency 19.543 ms 20 7883 62.74 MB/sec warmup 19 sec latency 53.587 ms 20 8287 61.25 MB/sec warmup 20 sec latency 19.993 ms 20 8755 61.35 MB/sec warmup 21 sec latency 22.727 ms 20 9156 58.92 MB/sec warmup 22 sec latency 18.321 ms 20 9597 58.10 MB/sec warmup 23 sec latency 23.976 ms 20 10870 100.73 MB/sec execute 1 sec latency 23.768 ms 20 11166 55.43 MB/sec execute 2 sec latency 19.667 ms 20 11455 40.15 MB/sec execute 3 sec latency 54.915 ms 20 11829 38.03 MB/sec execute 4 sec latency 29.099 ms 20 12257 42.96 MB/sec execute 5 sec latency 21.895 ms 20 12636 36.94 MB/sec execute 6 sec latency 20.092 ms 20 13110 37.00 MB/sec execute 7 sec latency 19.911 ms 20 13767 46.67 MB/sec execute 8 sec latency 23.700 ms 20 14360 52.73 MB/sec execute 9 sec latency 19.216 ms 20 14656 49.31 MB/sec execute 10 sec latency 20.901 ms 20 14945 45.48 MB/sec execute 11 sec latency 43.329 ms 20 15290 44.10 MB/sec execute 12 sec latency 25.597 ms 20 15728 45.83 MB/sec execute 13 sec latency 25.210 ms 20 16062 42.97 MB/sec execute 14 sec latency 19.913 ms 20 16397 40.87 MB/sec execute 15 sec latency 165.000 ms 20 16828 42.06 MB/sec execute 16 sec latency 21.892 ms 20 17585 47.02 MB/sec execute 17 sec latency 20.084 ms 20 18035 48.35 MB/sec execute 18 sec latency 19.851 ms 20 18318 46.14 MB/sec execute 19 sec latency 37.665 ms 20 18635 44.48 MB/sec execute 20 sec latency 37.900 ms 20 19020 44.37 MB/sec execute 21 sec latency 23.139 ms 20 19439 44.59 MB/sec execute 22 sec latency 21.866 ms 20 19844 43.01 MB/sec execute 23 sec latency 22.018 ms 20 20252 42.85 MB/sec execute 24 sec latency 21.467 ms 20 20863 45.44 MB/sec execute 25 sec latency 20.736 ms 20 21434 47.41 MB/sec execute 26 sec latency 21.363 ms 20 21726 46.58 MB/sec execute 27 sec latency 20.960 ms 20 22011 45.13 MB/sec execute 28 sec latency 45.868 ms 20 22328 44.26 MB/sec execute 29 sec latency 21.718 ms 20 22751 44.96 MB/sec execute 30 sec latency 26.072 ms 20 23108 44.06 MB/sec execute 31 sec latency 22.051 ms 20 23548 43.14 MB/sec execute 32 sec latency 18.916 ms 20 24057 44.25 MB/sec execute 33 sec latency 18.410 ms 20 24811 46.82 MB/sec execute 34 sec latency 20.994 ms 20 25213 46.82 MB/sec execute 35 sec latency 19.577 ms 20 25513 45.67 MB/sec execute 36 sec latency 40.195 ms 20 25867 45.00 MB/sec execute 37 sec latency 22.034 ms 20 26287 45.56 MB/sec execute 38 sec latency 26.371 ms 20 26660 44.83 MB/sec execute 39 sec latency 20.160 ms 20 27086 44.07 MB/sec execute 40 sec latency 16.723 ms 20 27569 44.68 MB/sec execute 41 sec latency 21.158 ms 20 28318 46.66 MB/sec execute 42 sec latency 22.089 ms 20 28725 46.96 MB/sec execute 43 sec latency 19.087 ms 20 29010 46.03 MB/sec execute 44 sec latency 43.649 ms 20 29333 45.34 MB/sec execute 45 sec latency 64.038 ms 20 29786 45.76 MB/sec execute 46 sec latency 20.154 ms 20 30183 45.33 MB/sec execute 47 sec latency 18.197 ms 20 30631 44.67 MB/sec execute 48 sec latency 19.115 ms 20 31114 45.27 MB/sec execute 49 sec latency 19.759 ms 20 31815 46.66 MB/sec execute 50 sec latency 25.620 ms 20 32224 47.02 MB/sec execute 51 sec latency 23.742 ms 20 32480 46.28 MB/sec execute 52 sec latency 56.644 ms 20 32798 45.61 MB/sec execute 53 sec latency 29.436 ms 20 33155 45.45 MB/sec execute 54 sec latency 22.673 ms 20 33567 45.64 MB/sec execute 55 sec latency 18.849 ms 20 33920 44.94 MB/sec execute 56 sec latency 22.576 ms 20 34373 44.71 MB/sec execute 57 sec latency 16.776 ms 20 34927 45.69 MB/sec execute 58 sec latency 21.756 ms 20 35552 46.66 MB/sec execute 59 sec latency 20.760 ms 20 35848 46.41 MB/sec execute 60 sec latency 26.142 ms 20 36099 45.75 MB/sec execute 61 sec latency 43.440 ms 20 36417 45.25 MB/sec execute 62 sec latency 31.426 ms 20 36812 45.26 MB/sec execute 63 sec latency 21.076 ms 20 37214 45.22 MB/sec execute 64 sec latency 24.179 ms 20 37603 44.69 MB/sec execute 65 sec latency 26.008 ms 20 38043 44.72 MB/sec execute 66 sec latency 20.830 ms 20 38681 45.68 MB/sec execute 67 sec latency 22.512 ms 20 39208 46.30 MB/sec execute 68 sec latency 23.433 ms 20 39507 45.95 MB/sec execute 69 sec latency 38.970 ms 20 39820 45.43 MB/sec execute 70 sec latency 42.458 ms 20 40192 45.29 MB/sec execute 71 sec latency 25.641 ms 20 40632 45.44 MB/sec execute 72 sec latency 18.927 ms 20 41024 44.96 MB/sec execute 73 sec latency 23.682 ms 20 41453 44.77 MB/sec execute 74 sec latency 19.515 ms 20 41931 45.34 MB/sec execute 75 sec latency 27.041 ms 20 42496 45.98 MB/sec execute 76 sec latency 24.055 ms 20 42846 46.02 MB/sec execute 77 sec latency 23.318 ms 20 43087 45.56 MB/sec execute 78 sec latency 41.381 ms 20 43381 45.10 MB/sec execute 79 sec latency 28.146 ms 20 43730 44.94 MB/sec execute 80 sec latency 35.036 ms 20 44105 45.06 MB/sec execute 81 sec latency 21.891 ms 20 44420 44.65 MB/sec execute 82 sec latency 22.797 ms 20 44826 44.30 MB/sec execute 83 sec latency 18.303 ms 20 45312 44.64 MB/sec execute 84 sec latency 18.980 ms 20 45958 45.32 MB/sec execute 85 sec latency 23.032 ms 20 46374 45.64 MB/sec execute 86 sec latency 24.852 ms 20 46636 45.24 MB/sec execute 87 sec latency 42.650 ms 20 46912 44.83 MB/sec execute 88 sec latency 47.903 ms 20 47206 44.59 MB/sec execute 89 sec latency 26.070 ms 20 47584 44.73 MB/sec execute 90 sec latency 23.812 ms 20 47911 44.42 MB/sec execute 91 sec latency 23.880 ms 20 48274 44.06 MB/sec execute 92 sec latency 24.528 ms 20 48655 44.03 MB/sec execute 93 sec latency 22.168 ms 20 49222 44.59 MB/sec execute 94 sec latency 25.791 ms 20 49724 45.05 MB/sec execute 95 sec latency 27.532 ms 20 50018 44.93 MB/sec execute 96 sec latency 23.128 ms 20 50248 44.52 MB/sec execute 97 sec latency 46.682 ms 20 50518 44.18 MB/sec execute 98 sec latency 34.683 ms 20 50835 44.02 MB/sec execute 99 sec latency 23.819 ms 20 51205 44.15 MB/sec execute 100 sec latency 22.957 ms 20 51525 43.82 MB/sec execute 101 sec latency 23.496 ms 20 51957 43.60 MB/sec execute 102 sec latency 18.485 ms 20 52465 43.98 MB/sec execute 103 sec latency 21.321 ms 20 53106 44.59 MB/sec execute 104 sec latency 27.455 ms 20 53491 44.66 MB/sec execute 105 sec latency 26.243 ms 20 53771 44.35 MB/sec execute 106 sec latency 37.492 ms 20 54064 44.04 MB/sec execute 107 sec latency 41.290 ms 20 54406 43.91 MB/sec execute 108 sec latency 26.266 ms 20 54794 44.04 MB/sec execute 109 sec latency 26.075 ms 20 55116 43.72 MB/sec execute 110 sec latency 23.914 ms 20 55524 43.52 MB/sec execute 111 sec latency 18.638 ms 20 55950 43.74 MB/sec execute 112 sec latency 24.077 ms 20 56590 44.32 MB/sec execute 113 sec latency 25.897 ms 20 57007 44.48 MB/sec execute 114 sec latency 25.828 ms 20 57259 44.20 MB/sec execute 115 sec latency 45.733 ms 20 57563 43.90 MB/sec execute 116 sec latency 41.891 ms 20 57893 43.76 MB/sec execute 117 sec latency 23.814 ms 20 58315 43.90 MB/sec execute 118 sec latency 22.482 ms 20 58673 43.63 MB/sec execute 119 sec latency 22.296 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 170273 8.135 56.637 Close 125062 1.984 19.631 Rename 7107 10.786 36.649 Unlink 34399 2.909 33.935 Qpathinfo 153963 1.890 37.657 Qfileinfo 26534 0.064 6.829 Qfsinfo 28080 0.028 9.844 Sfileinfo 13801 6.556 32.955 Find 59343 0.410 44.077 WriteX 83331 0.958 36.044 ReadX 262035 0.012 3.616 LockX 520 2.067 5.155 UnlockX 520 2.160 5.390 Flush 11889 7.630 164.994 Throughput 43.6266 MB/sec 20 clients 20 procs max_latency=165.000 ms stopping dbench on /mnt/lustre/d0.oleg115-client.virtnet at Tue Apr 16 15:43:23 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg115-client.virtnet /mnt/lustre/d0.oleg115-client.virtnet /mnt/lustre/d0.oleg115-client.virtnet removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg115-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 15:43:26 (1713296606) min OST has 3359536kB available, using 5039304kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7503] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4921] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg115-clien 4921M 163041 99 142358 93 386014 73 5929 288 Latency 9086us 33905us 82653us 58911us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg115-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 477 17 8063 32 683 12 480 17 1170 13 697 12 Latency 33202us 13196us 33517us 22974us 2250us 13582us 1.97,1.97,oleg115-client.virtnet,1,1713307210,4921M,,,,163041,99,142358,93,,,386014,73,5929,288,10,,,,,477,17,8063,32,683,12,480,17,1170,13,697,12,,9086us,33905us,,82653us,58911us,33202us,13196us,33517us,22974us,2250us,13582us debug=0x33f0484 PASS bonnie (170s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 15:46:19 (1713296779) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 2108 -P /tmp -l 5401164 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 2108 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x4ee76f fallocating to largest ever: 0x51a575 truncating to largest ever: 0x5210cd 001000 1713296781.966500 trunc from 0x411530 to 0x19f378 (0x2721b7 bytes) fallocating to largest ever: 0x526a4c 002000 1713296784.123405 mapread 0x174f67 thru 0x178924 (0x39be bytes) 004000 1713296788.620946 fallocate 0x3987cb thru 0x399aac (0x12e2 bytes) 005000 1713296791.159645 read 0x08a0f1 thru 0x099248 (0xf158 bytes) 006000 1713296793.745772 write 0x243de4 thru 0x252e0f (0xf02c bytes) 009000 1713296800.879396 mapwrite 0x49a082 thru 0x4a0f57 (0x6ed6 bytes) 010000 1713296803.015047 mapread 0x019cf8 thru 0x01a334 (0x63d bytes) 011000 1713296804.935018 punch from 0x3fb145 to 0x409eec (0xeda8 bytes) 013000 1713296809.013986 fallocate 0x11f4f6 thru 0x123c98 (0x47a3 bytes) 014000 1713296811.059338 mapread 0x079cea thru 0x0846dc (0xa9f3 bytes) 015000 1713296813.182984 read 0x4f0e15 thru 0x4fabe0 (0x9dcc bytes) 016000 1713296815.289048 fallocate 0x046ae7 thru 0x04788f (0xda9 bytes) 017000 1713296817.463485 read 0x46bac8 thru 0x46cb96 (0x10cf bytes) 018000 1713296819.819693 punch from 0x28baad to 0x2939cd (0x7f21 bytes) 020000 1713296823.883415 fallocate 0x3abfbc thru 0x3adc1c (0x1c61 bytes) 022000 1713296827.740353 read 0x0e05cd thru 0x0e0b31 (0x565 bytes) 023000 1713296829.576401 read 0x43a5cf thru 0x43be08 (0x183a bytes) 024000 1713296831.709349 fallocate 0x09d83d thru 0x0a8495 (0xac59 bytes) 025000 1713296833.692856 mapwrite 0x1fa1ce thru 0x208cd1 (0xeb04 bytes) 026000 1713296835.602987 write 0x1b309f thru 0x1b8d17 (0x5c79 bytes) 027000 1713296837.524622 mapread 0x0a58f4 thru 0x0af165 (0x9872 bytes) 028000 1713296839.603808 write 0x416615 thru 0x41957d (0x2f69 bytes) 030000 1713296843.998840 punch from 0x02d604 to 0x038ce1 (0xb6de bytes) 034000 1713296852.276786 write 0x196f05 thru 0x1a2c4b (0xbd47 bytes) 035000 1713296853.986577 fallocate 0x38c0ea thru 0x38cc11 (0xb28 bytes) 036000 1713296855.844214 read 0x416d5b thru 0x42504d (0xe2f3 bytes) 038000 1713296859.982092 mapwrite 0x03348c thru 0x037c6e (0x47e3 bytes) 039000 1713296861.959321 mapwrite 0x333f3b thru 0x339068 (0x512e bytes) 042000 1713296868.205206 trunc from 0x4fc5ca to 0x269baa (0x292a1f bytes) 046000 1713296876.654494 fallocate 0x1aa191 thru 0x1b303c (0x8eac bytes) 047000 1713296878.680181 fallocate 0x3cc224 thru 0x3d4551 (0x832e bytes) 048000 1713296880.805487 fallocate 0x26e369 thru 0x2747c3 (0x645b bytes) 052000 1713296889.175854 write 0x3cc76e thru 0x3ce191 (0x1a24 bytes) 053000 1713296891.614947 punch from 0x2ae0eb to 0x2b52fe (0x7214 bytes) 055000 1713296896.130600 mapread 0x061fe3 thru 0x068c1d (0x6c3b bytes) 056000 1713296898.332228 write 0x3b7020 thru 0x3bd2a7 (0x6288 bytes) 057000 1713296900.591724 write 0x215bcd thru 0x21f9df (0x9e13 bytes) 059000 1713296904.813807 mapwrite 0x159631 thru 0x15d512 (0x3ee2 bytes) 061000 1713296908.954047 write 0x06b6f2 thru 0x06f66f (0x3f7e bytes) 062000 1713296911.486000 mapwrite 0x1f5495 thru 0x201e56 (0xc9c2 bytes) 063000 1713296913.476744 fallocate 0x14b037 thru 0x14bb22 (0xaec bytes) 064000 1713296915.469296 trunc from 0x51c965 to 0x3fe1e7 (0x11e77d bytes) 066000 1713296919.584763 punch from 0x09392c to 0x09edf0 (0xb4c5 bytes) 067000 1713296921.537462 mapwrite 0x1f9f11 thru 0x207dc2 (0xdeb2 bytes) 068000 1713296923.391685 read 0x00aa08 thru 0x00d164 (0x275d bytes) 070000 1713296927.583206 trunc from 0x525a83 to 0x451639 (0xd4449 bytes) 074000 1713296936.474506 fallocate 0x19ee6c thru 0x1aa050 (0xb1e5 bytes) 075000 1713296938.946856 trunc from 0x520ccf to 0x02eb77 (0x4f2157 bytes) 076000 1713296941.011140 trunc from 0x21f0d7 to 0x0cd1f3 (0x151ee3 bytes) 077000 1713296942.977580 read 0x3edf9f thru 0x3fbf46 (0xdfa8 bytes) 079000 1713296947.398703 trunc from 0x4ac8d6 to 0x2ebc54 (0x1c0c81 bytes) 081000 1713296951.108103 mapwrite 0x268a71 thru 0x26f86e (0x6dfe bytes) 082000 1713296952.981709 mapwrite 0x40f311 thru 0x41bbd0 (0xc8c0 bytes) 083000 1713296955.388998 read 0x1e9e6d thru 0x1f0f41 (0x70d5 bytes) 084000 1713296957.409898 punch from 0x205b1d to 0x214655 (0xeb39 bytes) 085000 1713296959.410543 trunc from 0x42d0ee to 0x23c94d (0x1f07a0 bytes) 087000 1713296963.608958 read 0x15465a thru 0x15c3c2 (0x7d69 bytes) 088000 1713296965.565867 mapwrite 0x12cbc3 thru 0x134d1f (0x815d bytes) 089000 1713296967.448973 fallocate 0x4c68dc thru 0x4d2e72 (0xc597 bytes) 090000 1713296969.660131 punch from 0x171451 to 0x17602b (0x4bdb bytes) 091000 1713296971.599630 mapread 0x29069e thru 0x29cdac (0xc70f bytes) 094000 1713296978.147182 mapwrite 0x1da5ad thru 0x1ea4de (0xff32 bytes) 096000 1713296982.552284 punch from 0x0779e1 to 0x07927a (0x189a bytes) 099000 1713296989.058025 trunc from 0x22e7bb to 0x389048 (0x15a88e bytes) 100000 1713296990.867276 mapwrite 0x30ba9b thru 0x30c46f (0x9d5 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (212s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 15:49:53 (1713296993) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1713296996.597735 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1713296999.166600 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1713297001.731031 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1713297004.303263 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1713297009.408233 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1713297011.888802 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1713297014.606250 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1713297017.273284 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1713297019.860301 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1713297022.287064 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1713297024.945415 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1713297027.411259 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1713297030.908436 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1713297033.581070 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1713297036.118851 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1713297038.530930 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1713297041.281723 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1713297043.849608 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1713297046.360965 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1713297054.566994 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1713297058.006278 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1713297061.623013 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1713297064.597781 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1713297070.215277 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1713297075.860951 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1713297078.293605 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1713297081.081842 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1713297086.472372 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1713297089.542270 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1713297094.227777 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1713297096.757096 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1713297098.907393 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1713297101.470953 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1713297104.549500 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1713297109.675955 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1713297116.902099 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1713297124.458494 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1713297129.585284 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1713297132.049871 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1713297134.897423 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1713297141.838207 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1713297144.295303 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1713297146.839735 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1713297149.490094 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1713297152.083362 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1713297154.400139 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1713297156.768908 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1713297159.227220 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1713297161.863425 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1713297166.554273 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1713297169.280569 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1713297171.714073 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1713297174.358307 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1713297177.107245 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1713297182.238511 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1713297191.740192 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1713297197.969113 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1713297200.646873 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1713297203.227522 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1713297210.223371 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1713297213.338739 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1713297218.169252 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1713297220.731832 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1713297226.450149 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1713297232.168131 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1713297237.522568 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1713297240.257017 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1713297242.637138 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1713297244.855516 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1713297250.465073 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1713297252.957311 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1713297259.116119 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1713297261.811729 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (269s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 816 sec ====== 15:54:23 (1713297263) === sanity-benchmark: start cleanup 15:54:23 (1713297263) === === sanity-benchmark: finish cleanup 15:54:23 (1713297263) ===