-----============= acceptance-small: sanity-benchmark ============----- Fri Apr 19 08:49:54 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 08:49:56 (1713530996) === oleg254-client.virtnet: executing check_config_client /mnt/lustre oleg254-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg254-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6021000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6021000.idle_timeout=debug disable quota as required oleg254-server: oleg254-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity-benchmark: finish setup 08:50:03 (1713531003) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 08:50:04 (1713531004) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7338] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg254-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg254-client.virtnet at Fri Apr 19 08:50:04 EDT 2024 waiting for dbench pid 9472 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 276 206.64 MB/sec warmup 1 sec latency 45.967 ms 20 602 200.65 MB/sec warmup 2 sec latency 38.436 ms 20 1071 152.39 MB/sec warmup 3 sec latency 34.500 ms 20 1587 130.66 MB/sec warmup 4 sec latency 28.649 ms 20 2312 110.42 MB/sec warmup 5 sec latency 27.217 ms 20 2810 107.02 MB/sec warmup 6 sec latency 26.494 ms 20 3506 108.40 MB/sec warmup 7 sec latency 26.835 ms 20 3880 99.61 MB/sec warmup 8 sec latency 23.843 ms 20 4120 89.09 MB/sec warmup 9 sec latency 52.447 ms 20 4501 81.87 MB/sec warmup 10 sec latency 57.776 ms 20 5042 81.85 MB/sec warmup 11 sec latency 32.952 ms 20 5869 77.89 MB/sec warmup 12 sec latency 28.886 ms 20 6401 79.03 MB/sec warmup 13 sec latency 26.576 ms 20 7112 81.92 MB/sec warmup 14 sec latency 29.681 ms 20 7477 78.82 MB/sec warmup 15 sec latency 23.969 ms 20 7772 74.21 MB/sec warmup 16 sec latency 48.430 ms 20 8206 71.81 MB/sec warmup 17 sec latency 32.516 ms 20 8817 71.64 MB/sec warmup 18 sec latency 31.312 ms 20 9582 70.25 MB/sec warmup 19 sec latency 31.119 ms 20 10281 72.76 MB/sec warmup 20 sec latency 28.263 ms 20 10886 74.15 MB/sec warmup 21 sec latency 26.784 ms 20 11143 71.19 MB/sec warmup 22 sec latency 43.064 ms 20 11550 68.81 MB/sec warmup 23 sec latency 38.719 ms 20 12954 42.31 MB/sec execute 1 sec latency 38.495 ms 20 13516 68.16 MB/sec execute 2 sec latency 27.179 ms 20 14238 83.91 MB/sec execute 3 sec latency 28.491 ms 20 14589 72.64 MB/sec execute 4 sec latency 25.204 ms 20 14890 59.41 MB/sec execute 5 sec latency 40.026 ms 20 15342 55.85 MB/sec execute 6 sec latency 35.904 ms 20 15951 56.94 MB/sec execute 7 sec latency 33.794 ms 20 16657 55.39 MB/sec execute 8 sec latency 29.763 ms 20 17295 61.60 MB/sec execute 9 sec latency 31.116 ms 20 17936 65.95 MB/sec execute 10 sec latency 30.046 ms 20 18203 61.29 MB/sec execute 11 sec latency 25.661 ms 20 18517 56.92 MB/sec execute 12 sec latency 54.442 ms 20 18964 55.81 MB/sec execute 13 sec latency 36.571 ms 20 19803 56.58 MB/sec execute 14 sec latency 26.801 ms 20 20234 54.73 MB/sec execute 15 sec latency 434.564 ms 20 21037 59.91 MB/sec execute 16 sec latency 37.249 ms 20 21637 61.96 MB/sec execute 17 sec latency 28.212 ms 20 21975 58.94 MB/sec execute 18 sec latency 37.090 ms 20 22526 58.48 MB/sec execute 19 sec latency 24.497 ms 20 23375 58.79 MB/sec execute 20 sec latency 34.437 ms 20 24150 61.03 MB/sec execute 21 sec latency 21.127 ms 20 25005 64.38 MB/sec execute 22 sec latency 28.007 ms 20 25357 62.63 MB/sec execute 23 sec latency 38.335 ms 20 25790 60.75 MB/sec execute 24 sec latency 44.835 ms 20 26408 61.28 MB/sec execute 25 sec latency 25.668 ms 20 27299 60.98 MB/sec execute 26 sec latency 23.366 ms 20 28028 63.47 MB/sec execute 27 sec latency 25.082 ms 20 28688 64.82 MB/sec execute 28 sec latency 26.435 ms 20 28956 62.89 MB/sec execute 29 sec latency 37.969 ms 20 29405 61.53 MB/sec execute 30 sec latency 30.754 ms 20 30120 62.21 MB/sec execute 31 sec latency 23.508 ms 20 30937 62.09 MB/sec execute 32 sec latency 21.605 ms 20 31686 64.07 MB/sec execute 33 sec latency 24.098 ms 20 32278 64.70 MB/sec execute 34 sec latency 24.798 ms 20 32555 63.08 MB/sec execute 35 sec latency 39.629 ms 20 33054 62.31 MB/sec execute 36 sec latency 26.531 ms 20 33839 62.65 MB/sec execute 37 sec latency 25.212 ms 20 34613 62.89 MB/sec execute 38 sec latency 27.675 ms 20 35432 64.72 MB/sec execute 39 sec latency 29.080 ms 20 35901 64.63 MB/sec execute 40 sec latency 23.656 ms 20 36269 63.34 MB/sec execute 41 sec latency 42.411 ms 20 36875 63.23 MB/sec execute 42 sec latency 22.198 ms 20 37717 63.14 MB/sec execute 43 sec latency 21.803 ms 20 38503 64.37 MB/sec execute 44 sec latency 24.172 ms 20 39237 65.55 MB/sec execute 45 sec latency 63.825 ms 20 39577 64.59 MB/sec execute 46 sec latency 60.851 ms 20 40024 63.65 MB/sec execute 47 sec latency 31.007 ms 20 40754 63.96 MB/sec execute 48 sec latency 24.228 ms 20 41598 64.05 MB/sec execute 49 sec latency 32.044 ms 20 42354 65.25 MB/sec execute 50 sec latency 24.621 ms 20 42937 65.63 MB/sec execute 51 sec latency 34.134 ms 20 43305 64.58 MB/sec execute 52 sec latency 34.254 ms 20 43870 64.38 MB/sec execute 53 sec latency 29.423 ms 20 44677 64.32 MB/sec execute 54 sec latency 29.223 ms 20 45493 65.01 MB/sec execute 55 sec latency 24.338 ms 20 46262 66.18 MB/sec execute 56 sec latency 24.736 ms 20 46640 65.53 MB/sec execute 57 sec latency 30.964 ms 20 47128 64.86 MB/sec execute 58 sec latency 31.180 ms 20 47841 64.98 MB/sec execute 59 sec latency 28.770 ms 20 48683 65.11 MB/sec execute 60 sec latency 23.406 ms 20 49371 65.88 MB/sec execute 61 sec latency 26.567 ms 20 49988 66.28 MB/sec execute 62 sec latency 28.025 ms 20 50347 65.45 MB/sec execute 63 sec latency 36.134 ms 20 50916 65.20 MB/sec execute 64 sec latency 24.897 ms 20 51731 65.19 MB/sec execute 65 sec latency 26.187 ms 20 52537 65.67 MB/sec execute 66 sec latency 21.731 ms 20 53307 66.61 MB/sec execute 67 sec latency 28.507 ms 20 53725 66.17 MB/sec execute 68 sec latency 26.751 ms 20 54159 65.50 MB/sec execute 69 sec latency 42.251 ms 20 54867 65.66 MB/sec execute 70 sec latency 29.026 ms 20 55750 65.70 MB/sec execute 71 sec latency 22.481 ms 20 56573 66.66 MB/sec execute 72 sec latency 23.070 ms 20 57141 66.81 MB/sec execute 73 sec latency 23.798 ms 20 57501 66.10 MB/sec execute 74 sec latency 39.048 ms 20 58044 65.87 MB/sec execute 75 sec latency 82.025 ms 20 58906 65.87 MB/sec execute 76 sec latency 23.113 ms 20 59727 66.48 MB/sec execute 77 sec latency 23.822 ms 20 60463 67.15 MB/sec execute 78 sec latency 22.508 ms 20 60827 66.65 MB/sec execute 79 sec latency 50.253 ms 20 61277 66.10 MB/sec execute 80 sec latency 34.081 ms 20 62032 66.22 MB/sec execute 81 sec latency 26.481 ms 20 62908 66.35 MB/sec execute 82 sec latency 24.932 ms 20 63698 67.11 MB/sec execute 83 sec latency 21.744 ms 20 64257 67.18 MB/sec execute 84 sec latency 33.353 ms 20 64684 66.60 MB/sec execute 85 sec latency 42.933 ms 20 65355 66.49 MB/sec execute 86 sec latency 23.962 ms 20 66222 66.62 MB/sec execute 87 sec latency 21.259 ms 20 67009 67.27 MB/sec execute 88 sec latency 21.588 ms 20 67694 67.63 MB/sec execute 89 sec latency 21.348 ms 20 68066 67.07 MB/sec execute 90 sec latency 33.731 ms 20 68604 66.80 MB/sec execute 91 sec latency 24.964 ms 20 69378 66.82 MB/sec execute 92 sec latency 23.596 ms 20 70214 67.11 MB/sec execute 93 sec latency 22.585 ms 20 70997 67.71 MB/sec execute 94 sec latency 24.038 ms 20 71431 67.49 MB/sec execute 95 sec latency 27.474 ms 20 71831 67.02 MB/sec execute 96 sec latency 459.516 ms 20 72468 66.91 MB/sec execute 97 sec latency 488.664 ms 20 73347 67.01 MB/sec execute 98 sec latency 22.323 ms 20 74195 67.59 MB/sec execute 99 sec latency 21.322 ms 20 74844 67.85 MB/sec execute 100 sec latency 22.796 ms 20 75216 67.35 MB/sec execute 101 sec latency 32.277 ms 20 75803 67.16 MB/sec execute 102 sec latency 22.900 ms 20 76584 67.21 MB/sec execute 103 sec latency 23.694 ms 20 77420 67.47 MB/sec execute 104 sec latency 23.150 ms 20 78165 67.99 MB/sec execute 105 sec latency 58.769 ms 20 78617 67.73 MB/sec execute 106 sec latency 36.671 ms 20 79074 67.39 MB/sec execute 107 sec latency 26.059 ms 20 79783 67.35 MB/sec execute 108 sec latency 29.035 ms 20 80663 67.47 MB/sec execute 109 sec latency 25.230 ms 20 81439 67.99 MB/sec execute 110 sec latency 23.329 ms 20 82023 68.06 MB/sec execute 111 sec latency 24.683 ms 20 82434 67.63 MB/sec execute 112 sec latency 23.299 ms 20 83070 67.50 MB/sec execute 113 sec latency 28.444 ms 20 83893 67.59 MB/sec execute 114 sec latency 23.512 ms 20 84709 67.98 MB/sec execute 115 sec latency 23.113 ms 20 85382 68.27 MB/sec execute 116 sec latency 25.921 ms 20 85808 67.94 MB/sec execute 117 sec latency 27.514 ms 20 86403 67.75 MB/sec execute 118 sec latency 25.355 ms 20 87210 67.78 MB/sec execute 119 sec latency 23.529 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 262928 3.894 60.842 Close 193647 0.556 23.294 Rename 11089 10.822 37.320 Unlink 52599 3.723 26.486 Qpathinfo 238746 1.977 35.581 Qfileinfo 41823 0.063 7.061 Qfsinfo 43347 0.050 6.342 Sfileinfo 21296 7.601 35.064 Find 92055 0.472 42.243 WriteX 129994 0.926 22.607 ReadX 412611 0.010 7.336 LockX 862 2.252 11.742 UnlockX 862 2.298 8.650 Flush 18304 7.302 488.658 Throughput 67.7817 MB/sec 20 clients 20 procs max_latency=488.664 ms stopping dbench on /mnt/lustre/d0.oleg254-client.virtnet at Fri Apr 19 08:52:29 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg254-client.virtnet /mnt/lustre/d0.oleg254-client.virtnet /mnt/lustre/d0.oleg254-client.virtnet removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg254-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (147s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 08:52:33 (1713531153) min OST has 3336460kB available, using 5004690kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7338] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4887] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg254-clien 4887M 164042 99 161215 91 415835 74 3200 197 Latency 4869us 35801us 46513us 4876us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg254-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 367 25 4214 60 416 33 357 24 688 39 384 35 Latency 14402us 9864us 40244us 14565us 4287us 22943us 1.97,1.97,oleg254-client.virtnet,1,1713520819,4887M,,,,164042,99,161215,91,,,415835,74,3200,197,10,,,,,367,25,4214,60,416,33,357,24,688,39,384,35,,4869us,35801us,,46513us,4876us,14402us,9864us,40244us,14565us,4287us,22943us debug=0x33f0484 PASS bonnie (206s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 08:56:01 (1713531361) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 5403 -P /tmp -l 5408244 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 5403 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole fallocating to largest ever: 0x23a44a truncating to largest ever: 0x3436d1 truncating to largest ever: 0x3beffd truncating to largest ever: 0x427fc0 truncating to largest ever: 0x50f2eb fallocating to largest ever: 0x520351 truncating to largest ever: 0x527f9d fallocating to largest ever: 0x5285f4 002000 1713531367.483355 punch from 0x198853 to 0x1a4b68 (0xc316 bytes) 003000 1713531369.676851 fallocate 0x285195 thru 0x28db3f (0x89ab bytes) 004000 1713531372.147098 trunc from 0x2fe714 to 0x4955e4 (0x196ed1 bytes) 005000 1713531374.663440 read 0x0a801e thru 0x0aa32e (0x2311 bytes) 007000 1713531379.057892 read 0x2954a6 thru 0x2a0620 (0xb17b bytes) 008000 1713531381.079005 mapread 0x20418e thru 0x2067ec (0x265f bytes) 009000 1713531383.126365 write 0x232f29 thru 0x23e9e7 (0xbabf bytes) 010000 1713531385.091857 read 0x2c3799 thru 0x2ced73 (0xb5db bytes) 012000 1713531389.414393 write 0x106055 thru 0x111879 (0xb825 bytes) 014000 1713531394.101410 punch from 0x3b1107 to 0x3bc1f3 (0xb0ed bytes) 016000 1713531399.362204 fallocate 0x2d6691 thru 0x2dc245 (0x5bb5 bytes) 017000 1713531401.800544 write 0x04d9b1 thru 0x050146 (0x2796 bytes) 018000 1713531404.138633 mapwrite 0x1698e1 thru 0x173248 (0x9968 bytes) 019000 1713531406.259124 mapwrite 0x2ddbce thru 0x2e1af9 (0x3f2c bytes) 020000 1713531408.917051 punch from 0x26ad39 to 0x274334 (0x95fc bytes) 021000 1713531411.486096 read 0x0fa017 thru 0x107788 (0xd772 bytes) 022000 1713531413.915347 punch from 0x16c294 to 0x179d1e (0xda8b bytes) 024000 1713531418.309101 punch from 0x37e53b to 0x382867 (0x432d bytes) 025000 1713531420.535746 mapwrite 0x235339 thru 0x23ad49 (0x5a11 bytes) 026000 1713531422.688961 mapwrite 0x0188cf thru 0x021b5a (0x928c bytes) 028000 1713531427.227575 read 0x20902e thru 0x20a879 (0x184c bytes) 030000 1713531431.357169 fallocate 0x2bdb03 thru 0x2c7377 (0x9875 bytes) 031000 1713531433.553837 fallocate 0x5183e4 thru 0x5241c3 (0xbde0 bytes) 032000 1713531435.592483 mapread 0x088126 thru 0x094dd0 (0xccab bytes) 034000 1713531440.234503 read 0x034671 thru 0x041180 (0xcb10 bytes) 035000 1713531442.298202 mapread 0x19065b thru 0x1a038c (0xfd32 bytes) 037000 1713531446.847274 read 0x1c0746 thru 0x1c3847 (0x3102 bytes) 039000 1713531451.107424 trunc from 0x12c2c8 to 0x25b260 (0x12ef99 bytes) 040000 1713531453.353657 mapread 0x0068b2 thru 0x00f702 (0x8e51 bytes) 041000 1713531455.317223 mapwrite 0x2b5c3a thru 0x2bc4c9 (0x6890 bytes) 042000 1713531457.658473 read 0x047791 thru 0x050a59 (0x92c9 bytes) 043000 1713531459.667779 punch from 0x0daee7 to 0x0e6524 (0xb63e bytes) 045000 1713531465.650622 mapwrite 0x31d4ca thru 0x3222d5 (0x4e0c bytes) 046000 1713531468.082624 punch from 0x1cb4a9 to 0x1d1c36 (0x678e bytes) 047000 1713531470.756884 mapwrite 0x41f245 thru 0x4212a3 (0x205f bytes) 048000 1713531472.954217 read 0x196818 thru 0x1a41ac (0xd995 bytes) 049000 1713531474.867321 fallocate 0x0c2b3d thru 0x0c7bf4 (0x50b8 bytes) 050000 1713531477.202913 read 0x2112ff thru 0x220600 (0xf302 bytes) 051000 1713531479.988780 mapwrite 0x1d0d4a thru 0x1d44d7 (0x378e bytes) 054000 1713531486.730249 mapread 0x3143a4 thru 0x31ded8 (0x9b35 bytes) 059000 1713531498.884833 punch from 0x2c748b to 0x2d13bd (0x9f33 bytes) 062000 1713531506.243149 punch from 0x0a11d0 to 0x0a71e3 (0x6014 bytes) 065000 1713531512.982386 fallocate 0x002604 thru 0x011de4 (0xf7e1 bytes) 066000 1713531515.691032 mapread 0x06f896 thru 0x07dea2 (0xe60d bytes) 067000 1713531517.711892 write 0x11ab89 thru 0x129ed7 (0xf34f bytes) 068000 1713531519.727273 read 0x0cbbb7 thru 0x0d8d4f (0xd199 bytes) 069000 1713531522.048459 punch from 0x1304b8 to 0x13c073 (0xbbbc bytes) 074000 1713531533.096869 punch from 0x04893d to 0x04dfbb (0x567f bytes) 075000 1713531535.257797 fallocate 0x366ab3 thru 0x3714f7 (0xaa45 bytes) 076000 1713531538.111318 punch from 0x12cc85 to 0x13bae8 (0xee64 bytes) 078000 1713531542.654342 read 0x1a6761 thru 0x1aefc8 (0x8868 bytes) 081000 1713531551.583251 mapread 0x30e586 thru 0x31b715 (0xd190 bytes) 082000 1713531554.443758 read 0x3b94b8 thru 0x3c7dae (0xe8f7 bytes) 083000 1713531557.167886 mapread 0x09e587 thru 0x0a5739 (0x71b3 bytes) 085000 1713531561.910851 fallocate 0x2cf299 thru 0x2d703b (0x7da3 bytes) 086000 1713531564.319279 punch from 0x1a30db to 0x1a67b2 (0x36d8 bytes) 089000 1713531573.868565 fallocate 0x410324 thru 0x4110df (0xdbc bytes) 090000 1713531576.895776 read 0x16455f thru 0x16bbe1 (0x7683 bytes) 091000 1713531579.508025 fallocate 0x36e0dc thru 0x37bd5d (0xdc82 bytes) 093000 1713531584.618360 fallocate 0x095761 thru 0x099694 (0x3f34 bytes) 094000 1713531586.736984 mapwrite 0x01e3d8 thru 0x02cb5a (0xe783 bytes) 095000 1713531589.653877 write 0x159fb9 thru 0x15d51c (0x3564 bytes) 097000 1713531595.750144 write 0x1a6253 thru 0x1a6882 (0x630 bytes) 099000 1713531600.988959 punch from 0x1422b6 to 0x14d5af (0xb2fa bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (242s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 09:00:05 (1713531605) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fallocating to largest ever: 0x486b53 skipping zero size read truncating to largest ever: 0x523479 001000 1713531608.406912 trunc from 0x4c34a7 to 0x4c88d5 (0x542f bytes) 002000 1713531610.820983 punch from 0x2e2fb6 to 0x2e8ad5 (0x5b20 bytes) truncating to largest ever: 0x5235fe fallocating to largest ever: 0x52606f 003000 1713531613.219565 fallocate 0x1b6969 thru 0x1c0f97 (0xa62f bytes) 004000 1713531615.607566 fallocate 0x0b9616 thru 0x0c44b4 (0xae9f bytes) 006000 1713531620.478205 fallocate 0x1c770d thru 0x1ce30d (0x6c01 bytes) fallocating to largest ever: 0x5283bd 007000 1713531623.305842 mapread 0x4b015c thru 0x4bb13c (0xafe1 bytes) 008000 1713531625.938379 punch from 0x042841 to 0x04b0fb (0x88bb bytes) 009000 1713531628.400680 write 0x1f0e1a thru 0x1ff750 (0xe937 bytes) 010000 1713531631.166997 fallocate 0x51f5d4 thru 0x5283bc (0x8de9 bytes) 011000 1713531633.434922 mapread 0x0483cf thru 0x04d366 (0x4f98 bytes) 012000 1713531635.812912 punch from 0x001428 to 0x005c53 (0x482c bytes) 013000 1713531638.112896 write 0x49170b thru 0x49e6a3 (0xcf99 bytes) 014000 1713531640.251061 write 0x2505e6 thru 0x25ac38 (0xa653 bytes) 015000 1713531642.658636 punch from 0x0936eb to 0x09ca88 (0x939e bytes) 016000 1713531644.972269 trunc from 0x4d84f9 to 0x2fdd23 (0x1da7d5 bytes) 017000 1713531647.158316 punch from 0x0c80f7 to 0x0d6f46 (0xee50 bytes) 018000 1713531649.894643 fallocate 0x030846 thru 0x038fb4 (0x876f bytes) 019000 1713531652.608477 fallocate 0x14baac thru 0x14f909 (0x3e5e bytes) 020000 1713531655.147879 fallocate 0x32d1ae thru 0x334916 (0x7769 bytes) 023000 1713531663.281373 trunc from 0x44a9d8 to 0x43be5c (0xeb7b bytes) 024000 1713531666.400658 mapwrite 0x1a4a5f thru 0x1abfe3 (0x7585 bytes) 025000 1713531669.251455 mapread 0x0a02da thru 0x0a9b9b (0x98c2 bytes) 026000 1713531671.960433 mapread 0x2d7d99 thru 0x2e6b4c (0xedb4 bytes) 028000 1713531677.079566 trunc from 0x3561c4 to 0x044c50 (0x311573 bytes) 030000 1713531682.272853 write 0x45e806 thru 0x462805 (0x4000 bytes) 031000 1713531685.491207 mapread 0x48fb50 thru 0x499efb (0xa3ac bytes) 032000 1713531689.644338 fallocate 0x2a2a87 thru 0x2a2e8c (0x406 bytes) 034000 1713531698.402822 mapread 0x22bae6 thru 0x22de19 (0x2334 bytes) 035000 1713531703.134176 write 0x3929d9 thru 0x39802b (0x5653 bytes) 037000 1713531710.184656 fallocate 0x1f9674 thru 0x1febff (0x558c bytes) 038000 1713531713.941388 read 0x29eca2 thru 0x29f0b4 (0x413 bytes) 039000 1713531717.642444 mapwrite 0x486e1d thru 0x491169 (0xa34d bytes) 040000 1713531722.074722 mapwrite 0x174117 thru 0x177514 (0x33fe bytes) 041000 1713531726.051139 fallocate 0x3effcc thru 0x3fb52b (0xb560 bytes) 043000 1713531733.979452 mapread 0x27ec62 thru 0x287af3 (0x8e92 bytes) 046000 1713531743.997635 mapread 0x118391 thru 0x123cb7 (0xb927 bytes) 049000 1713531755.411052 read 0x15bed1 thru 0x15c38f (0x4bf bytes) 051000 1713531763.693681 mapread 0x2f1a37 thru 0x2fdbc5 (0xc18f bytes) 052000 1713531768.017674 read 0x3526b6 thru 0x353243 (0xb8e bytes) 053000 1713531772.870466 read 0x1c3aac thru 0x1c8d11 (0x5266 bytes) 056000 1713531784.991033 write 0x4f7191 thru 0x4fdf99 (0x6e09 bytes) 057000 1713531789.312388 mapwrite 0x01e129 thru 0x0269d3 (0x88ab bytes) 058000 1713531793.445666 trunc from 0x4d6bae to 0x085fa3 (0x450c0a bytes) 059000 1713531797.067497 fallocate 0x3bd534 thru 0x3bd9b2 (0x47f bytes) 060000 1713531801.509772 punch from 0x000906 to 0x000e69 (0x564 bytes) 061000 1713531805.494527 mapread 0x33a060 thru 0x33b294 (0x1235 bytes) 062000 1713531808.732399 write 0x3f2d7e thru 0x3f5962 (0x2be5 bytes) 063000 1713531812.712103 punch from 0x086759 to 0x0940a2 (0xd94a bytes) 064000 1713531816.427571 write 0x1e2cbb thru 0x1ee115 (0xb45b bytes) 066000 1713531824.134070 trunc from 0x1c5174 to 0x50e10e (0x348f9b bytes) skipping zero size read 067000 1713531828.495214 read 0x084857 thru 0x08cbcc (0x8376 bytes) 068000 1713531831.577995 punch from 0x4bbc72 to 0x4bc7a7 (0xb36 bytes) 069000 1713531835.522892 write 0x2eb1b1 thru 0x2fa8f9 (0xf749 bytes) 070000 1713531839.554679 mapread 0x016609 thru 0x01839b (0x1d93 bytes) 072000 1713531846.781399 fallocate 0x2ea86a thru 0x2f27a3 (0x7f3a bytes) 075000 1713531860.331970 mapread 0x0aea6e thru 0x0b4b43 (0x60d6 bytes) 077000 1713531868.896330 mapread 0x04a932 thru 0x055fcd (0xb69c bytes) 078000 1713531873.238655 mapread 0x150414 thru 0x151307 (0xef4 bytes) 079000 1713531877.163676 mapread 0x4a8a34 thru 0x4b4955 (0xbf22 bytes) 081000 1713531885.565018 fallocate 0x4c5c8a thru 0x4c86d6 (0x2a4d bytes) 082000 1713531890.264005 fallocate 0x025be7 thru 0x03540f (0xf829 bytes) 084000 1713531898.485265 mapread 0x2fa53f thru 0x3002d1 (0x5d93 bytes) 085000 1713531902.583833 punch from 0x007f00 to 0x00aea5 (0x2fa6 bytes) skipping zero size read 087000 1713531910.179489 read 0x07a081 thru 0x088270 (0xe1f0 bytes) 089000 1713531917.470583 punch from 0x340f56 to 0x34e954 (0xd9ff bytes) 091000 1713531926.503060 read 0x0cf7bd thru 0x0d2cce (0x3512 bytes) 092000 1713531930.693724 punch from 0x355d94 to 0x35d263 (0x74d0 bytes) 093000 1713531934.540559 read 0x305a76 thru 0x30ab6d (0x50f8 bytes) 094000 1713531937.753302 mapread 0x2dc464 thru 0x2e7993 (0xb530 bytes) 096000 1713531945.418011 fallocate 0x3e2876 thru 0x3e2e91 (0x61c bytes) 097000 1713531949.519435 write 0x3e2261 thru 0x3e3a4f (0x17ef bytes) 099000 1713531957.383781 punch from 0x14d7ed to 0x15256c (0x4d80 bytes) 100000 1713531961.899492 read 0x18d504 thru 0x19a3a3 (0xcea0 bytes) All operations completed A-OK! PASS fsx_partial_punch (358s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 970 sec ====== 09:06:04 (1713531964) === sanity-benchmark: start cleanup 09:06:04 (1713531964) === === sanity-benchmark: finish cleanup 09:06:04 (1713531964) ===