-----============= acceptance-small: sanity-benchmark ============----- Thu Apr 18 18:50:55 EDT 2024 excepting tests: skipping tests SLOW=no: iozone === sanity-benchmark: start setup 18:50:59 (1713480659) === oleg109-client.virtnet: executing check_config_client /mnt/lustre oleg109-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg109-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6767800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6767800.idle_timeout=debug disable quota as required oleg109-server: oleg109-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-benchmark: finish setup 18:51:07 (1713480667) === debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test dbench: dbench ================== 18:51:09 (1713480669) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6897] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg109-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg109-client.virtnet at Thu Apr 18 18:51:10 EDT 2024 waiting for dbench pid 8912 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 209 163.79 MB/sec warmup 1 sec latency 67.019 ms 20 456 160.05 MB/sec warmup 2 sec latency 38.326 ms 20 718 141.70 MB/sec warmup 3 sec latency 232.714 ms 20 926 108.80 MB/sec warmup 4 sec latency 93.788 ms 20 1249 92.32 MB/sec warmup 5 sec latency 81.720 ms 20 1626 87.19 MB/sec warmup 6 sec latency 119.146 ms 20 1932 75.50 MB/sec warmup 7 sec latency 94.476 ms 20 2331 69.40 MB/sec warmup 8 sec latency 112.875 ms 20 2650 66.87 MB/sec warmup 9 sec latency 114.593 ms 20 3085 67.81 MB/sec warmup 10 sec latency 212.860 ms 20 3603 70.16 MB/sec warmup 11 sec latency 163.750 ms 20 3889 66.45 MB/sec warmup 12 sec latency 20.871 ms 20 4112 61.70 MB/sec warmup 13 sec latency 197.751 ms 20 4307 57.77 MB/sec warmup 14 sec latency 172.920 ms 20 4497 54.62 MB/sec warmup 15 sec latency 149.725 ms 20 4818 53.51 MB/sec warmup 16 sec latency 132.263 ms 20 5154 53.24 MB/sec warmup 17 sec latency 103.086 ms 20 5427 50.55 MB/sec warmup 18 sec latency 63.018 ms 20 5770 48.58 MB/sec warmup 19 sec latency 64.313 ms 20 6104 48.27 MB/sec warmup 20 sec latency 143.256 ms 20 6600 50.55 MB/sec warmup 21 sec latency 121.069 ms 20 7071 51.19 MB/sec warmup 22 sec latency 155.584 ms 20 7429 51.30 MB/sec warmup 23 sec latency 20.943 ms 20 7874 7.17 MB/sec execute 1 sec latency 167.615 ms 20 8081 11.13 MB/sec execute 2 sec latency 124.177 ms 20 8401 20.06 MB/sec execute 3 sec latency 123.555 ms 20 8733 25.72 MB/sec execute 4 sec latency 85.338 ms 20 9025 21.82 MB/sec execute 5 sec latency 71.913 ms 20 9389 21.65 MB/sec execute 6 sec latency 62.666 ms 20 9712 25.14 MB/sec execute 7 sec latency 131.448 ms 20 10190 32.54 MB/sec execute 8 sec latency 154.621 ms 20 10575 34.74 MB/sec execute 9 sec latency 223.174 ms 20 10922 37.24 MB/sec execute 10 sec latency 68.733 ms 20 11138 34.68 MB/sec execute 11 sec latency 128.114 ms 20 11350 32.17 MB/sec execute 12 sec latency 128.678 ms 20 11527 30.57 MB/sec execute 13 sec latency 142.786 ms 20 11780 30.06 MB/sec execute 14 sec latency 116.484 ms 20 12139 31.52 MB/sec execute 15 sec latency 124.841 ms 20 12409 30.52 MB/sec execute 16 sec latency 66.479 ms 20 12702 29.34 MB/sec execute 17 sec latency 86.574 ms 20 13038 29.03 MB/sec execute 18 sec latency 123.650 ms 20 13397 30.58 MB/sec execute 19 sec latency 125.460 ms 20 13885 33.11 MB/sec execute 20 sec latency 138.498 ms 20 14318 35.04 MB/sec execute 21 sec latency 143.374 ms 20 14577 34.59 MB/sec execute 22 sec latency 104.230 ms 20 14780 33.29 MB/sec execute 23 sec latency 149.099 ms 20 14979 32.30 MB/sec execute 24 sec latency 182.588 ms 20 15165 31.44 MB/sec execute 25 sec latency 102.679 ms 20 15473 31.87 MB/sec execute 26 sec latency 106.641 ms 20 15805 32.17 MB/sec execute 27 sec latency 113.338 ms 20 16090 31.36 MB/sec execute 28 sec latency 81.319 ms 20 16398 30.73 MB/sec execute 29 sec latency 73.639 ms 20 16732 30.94 MB/sec execute 30 sec latency 141.146 ms 20 17112 32.04 MB/sec execute 31 sec latency 139.688 ms 20 17595 33.43 MB/sec execute 32 sec latency 141.138 ms 20 17957 34.22 MB/sec execute 33 sec latency 121.115 ms 20 18203 33.73 MB/sec execute 34 sec latency 108.465 ms 20 18435 32.97 MB/sec execute 35 sec latency 118.290 ms 20 18629 32.30 MB/sec execute 36 sec latency 170.862 ms 20 18864 31.88 MB/sec execute 37 sec latency 109.964 ms 20 19201 32.34 MB/sec execute 38 sec latency 96.649 ms 20 19499 32.24 MB/sec execute 39 sec latency 120.290 ms 20 19792 31.66 MB/sec execute 40 sec latency 68.683 ms 20 20131 31.40 MB/sec execute 41 sec latency 63.624 ms 20 20477 31.86 MB/sec execute 42 sec latency 146.771 ms 20 20925 32.94 MB/sec execute 43 sec latency 111.352 ms 20 21334 33.53 MB/sec execute 44 sec latency 166.796 ms 20 21653 33.89 MB/sec execute 45 sec latency 92.249 ms 20 21885 33.37 MB/sec execute 46 sec latency 113.110 ms 20 22104 32.79 MB/sec execute 47 sec latency 195.627 ms 20 22301 32.35 MB/sec execute 48 sec latency 145.805 ms 20 22556 32.16 MB/sec execute 49 sec latency 112.371 ms 20 22931 32.73 MB/sec execute 50 sec latency 95.027 ms 20 23217 32.30 MB/sec execute 51 sec latency 82.131 ms 20 23531 31.99 MB/sec execute 52 sec latency 65.680 ms 20 23879 32.05 MB/sec execute 53 sec latency 111.507 ms 20 24245 32.54 MB/sec execute 54 sec latency 149.566 ms 20 24709 33.23 MB/sec execute 55 sec latency 117.805 ms 20 25112 33.86 MB/sec execute 56 sec latency 94.973 ms 20 25369 33.63 MB/sec execute 57 sec latency 97.833 ms 20 25606 33.14 MB/sec execute 58 sec latency 132.969 ms 20 25811 32.77 MB/sec execute 59 sec latency 162.922 ms 20 26054 32.51 MB/sec execute 60 sec latency 101.176 ms 20 26416 32.83 MB/sec execute 61 sec latency 101.556 ms 20 26741 32.84 MB/sec execute 62 sec latency 70.512 ms 20 27024 32.48 MB/sec execute 63 sec latency 76.734 ms 20 27362 32.38 MB/sec execute 64 sec latency 109.280 ms 20 27707 32.67 MB/sec execute 65 sec latency 110.302 ms 20 28178 33.28 MB/sec execute 66 sec latency 129.723 ms 20 28589 33.92 MB/sec execute 67 sec latency 90.540 ms 20 28844 33.78 MB/sec execute 68 sec latency 119.525 ms 20 29076 33.42 MB/sec execute 69 sec latency 114.375 ms 20 29292 33.04 MB/sec execute 70 sec latency 170.002 ms 20 29485 32.74 MB/sec execute 71 sec latency 160.010 ms 20 29775 32.75 MB/sec execute 72 sec latency 123.609 ms 20 30144 33.07 MB/sec execute 73 sec latency 82.455 ms 20 30409 32.78 MB/sec execute 74 sec latency 121.915 ms 20 30720 32.56 MB/sec execute 75 sec latency 79.459 ms 20 31084 32.63 MB/sec execute 76 sec latency 95.324 ms 20 31472 32.99 MB/sec execute 77 sec latency 125.472 ms 20 31930 33.40 MB/sec execute 78 sec latency 131.907 ms 20 32302 33.82 MB/sec execute 79 sec latency 123.668 ms 20 32558 33.60 MB/sec execute 80 sec latency 117.270 ms 20 32800 33.28 MB/sec execute 81 sec latency 140.314 ms 20 32999 32.98 MB/sec execute 82 sec latency 130.421 ms 20 33288 32.96 MB/sec execute 83 sec latency 104.057 ms 20 33675 33.28 MB/sec execute 84 sec latency 90.964 ms 20 33988 33.12 MB/sec execute 85 sec latency 66.757 ms 20 34330 32.90 MB/sec execute 86 sec latency 63.928 ms 20 34699 33.00 MB/sec execute 87 sec latency 146.956 ms 20 35101 33.40 MB/sec execute 88 sec latency 125.034 ms 20 35526 33.67 MB/sec execute 89 sec latency 145.753 ms 20 35856 33.91 MB/sec execute 90 sec latency 102.591 ms 20 36099 33.75 MB/sec execute 91 sec latency 109.527 ms 20 36337 33.45 MB/sec execute 92 sec latency 130.759 ms 20 36543 33.21 MB/sec execute 93 sec latency 196.310 ms 20 36786 33.09 MB/sec execute 94 sec latency 127.572 ms 20 37132 33.22 MB/sec execute 95 sec latency 119.099 ms 20 37468 33.30 MB/sec execute 96 sec latency 88.412 ms 20 37756 33.07 MB/sec execute 97 sec latency 85.547 ms 20 38093 32.98 MB/sec execute 98 sec latency 87.988 ms 20 38381 33.03 MB/sec execute 99 sec latency 176.961 ms 20 38801 33.46 MB/sec execute 100 sec latency 192.588 ms 20 39215 33.72 MB/sec execute 101 sec latency 131.437 ms 20 39514 33.79 MB/sec execute 102 sec latency 123.210 ms 20 39749 33.57 MB/sec execute 103 sec latency 127.997 ms 20 39983 33.31 MB/sec execute 104 sec latency 183.794 ms 20 40215 33.19 MB/sec execute 105 sec latency 103.033 ms 20 40529 33.22 MB/sec execute 106 sec latency 151.200 ms 20 40915 33.43 MB/sec execute 107 sec latency 80.134 ms 20 41201 33.21 MB/sec execute 108 sec latency 88.338 ms 20 41513 33.08 MB/sec execute 109 sec latency 102.359 ms 20 41850 33.12 MB/sec execute 110 sec latency 121.387 ms 20 42203 33.38 MB/sec execute 111 sec latency 172.463 ms 20 42620 33.59 MB/sec execute 112 sec latency 150.220 ms 20 42962 33.79 MB/sec execute 113 sec latency 120.261 ms 20 43191 33.63 MB/sec execute 114 sec latency 168.810 ms 20 43402 33.42 MB/sec execute 115 sec latency 122.621 ms 20 43651 33.24 MB/sec execute 116 sec latency 111.549 ms 20 43931 33.22 MB/sec execute 117 sec latency 122.827 ms 20 44239 33.25 MB/sec execute 118 sec latency 83.259 ms 20 44591 33.32 MB/sec execute 119 sec latency 90.982 ms 20 cleanup 120 sec 0 cleanup 121 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 128940 9.038 59.557 Close 95167 2.272 22.971 Rename 5474 12.048 43.581 Unlink 25839 3.801 57.245 Qpathinfo 116840 2.024 47.870 Qfileinfo 20387 0.058 7.368 Qfsinfo 21261 0.023 7.681 Sfileinfo 10751 5.938 36.518 Find 45050 0.365 37.754 WriteX 63729 0.717 17.335 ReadX 200678 0.010 2.599 LockX 406 2.590 13.137 UnlockX 406 2.534 10.524 Flush 9200 52.456 223.166 Throughput 33.3244 MB/sec 20 clients 20 procs max_latency=223.174 ms stopping dbench on /mnt/lustre/d0.oleg109-client.virtnet at Thu Apr 18 18:53:35 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg109-client.virtnet /mnt/lustre/d0.oleg109-client.virtnet /mnt/lustre/d0.oleg109-client.virtnet removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg109-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test bonnie: bonnie++ ================ 18:53:40 (1713480820) min OST has 3135488kB available, using 4703232kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6897] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4593] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg109-clien 4593M 157867 98 158443 95 445023 76 2469 126 Latency 1966us 36005us 28580us 218ms Version 1.97 ------Sequential Create------ --------Random Create-------- oleg109-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 283 15 9170 31 368 11 294 16 603 12 517 11 Latency 23020us 10601us 76438us 19924us 10014us 16243us 1.97,1.97,oleg109-client.virtnet,1,1713472279,4593M,,,,157867,98,158443,95,,,445023,76,2469,126,10,,,,,283,15,9170,31,368,11,294,16,603,12,517,11,,1966us,36005us,,28580us,218ms,23020us,10601us,76438us,19924us,10014us,16243us debug=0x33f0484 PASS bonnie (216s) debug_raw_pointers=0 debug_raw_pointers=0 SKIP: sanity-benchmark test_iozone skipping SLOW test iozone debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx: fsx ======================== 18:57:19 (1713481039) fallocate on zfs doesn't consume space fallocate not supported debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 12178 -P /tmp -l 5647872 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 12178 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x432cf6 truncating to largest ever: 0x4d3cc1 truncating to largest ever: 0x56013e 001000 1713481045.173294 mapwrite 0x0ec763 thru 0x0f4e41 (0x86df bytes) truncating to largest ever: 0x561373 006000 1713481067.565473 trunc from 0x4ea849 to 0x1e804f (0x3027f9 bytes) 008000 1713481076.385616 write 0x3af276 thru 0x3b615f (0x6eea bytes) 012000 1713481090.527399 trunc from 0x22ab3a to 0x02af8d (0x1ffbac bytes) 013000 1713481093.649515 trunc from 0x4559aa to 0x1cda96 (0x287f13 bytes) 014000 1713481097.161709 read 0x35a69d thru 0x361ac9 (0x742d bytes) skipping zero size read 018000 1713481111.303469 read 0x0ca802 thru 0x0d5883 (0xb082 bytes) 020000 1713481120.098764 mapwrite 0x42e640 thru 0x430e83 (0x2844 bytes) 021000 1713481124.820253 trunc from 0x228795 to 0x366c64 (0x13e4d0 bytes) 026000 1713481147.765658 read 0x499319 thru 0x4a34a3 (0xa18b bytes) 029000 1713481160.170163 mapwrite 0x5300f6 thru 0x538ecb (0x8dd6 bytes) truncating to largest ever: 0x561974 030000 1713481164.714125 read 0x360417 thru 0x365626 (0x5210 bytes) 034000 1713481181.428705 mapwrite 0x23157c thru 0x237d97 (0x681c bytes) 035000 1713481184.858384 write 0x09ef9e thru 0x0a7021 (0x8084 bytes) truncating to largest ever: 0x562689 039000 1713481199.679454 mapread 0x452d1a thru 0x45be2e (0x9115 bytes) 040000 1713481203.511375 read 0x04875b thru 0x0519a7 (0x924d bytes) 042000 1713481211.706299 mapread 0x107918 thru 0x112406 (0xaaef bytes) 043000 1713481215.389449 trunc from 0x334861 to 0x1663e8 (0x1ce478 bytes) 044000 1713481218.497249 mapread 0x09036a thru 0x099b47 (0x97de bytes) 046000 1713481226.572217 write 0x51e20a thru 0x529d7a (0xbb71 bytes) 047000 1713481229.808415 read 0x2f7e70 thru 0x304083 (0xc214 bytes) 048000 1713481234.239112 read 0x1a99b3 thru 0x1b32db (0x9929 bytes) 049000 1713481237.989064 mapwrite 0x0ee1e2 thru 0x0ef419 (0x1238 bytes) 050000 1713481241.280097 trunc from 0x3d9071 to 0x27e8d2 (0x15a79e bytes) 051000 1713481245.708923 write 0x4253d0 thru 0x42b005 (0x5c36 bytes) 052000 1713481249.543600 mapwrite 0x121e09 thru 0x12b804 (0x99fc bytes) 054000 1713481258.423903 mapread 0x37ab80 thru 0x383c08 (0x9089 bytes) 055000 1713481262.906789 mapread 0x0a729e thru 0x0ad671 (0x63d4 bytes) 057000 1713481271.899348 mapread 0x16fc3d thru 0x17fb14 (0xfed8 bytes) 058000 1713481275.969713 mapwrite 0x0deadd thru 0x0ee8cc (0xfdf0 bytes) 059000 1713481279.620928 trunc from 0x55f940 to 0x55df87 (0x19b8 bytes) 060000 1713481283.925344 mapwrite 0x1abb3a thru 0x1b795f (0xbe26 bytes) 066000 1713481303.872251 read 0x04c527 thru 0x050f74 (0x4a4e bytes) 067000 1713481307.888376 mapwrite 0x13da78 thru 0x149a5f (0xbfe8 bytes) 070000 1713481320.100100 trunc from 0x006f18 to 0x03ce24 (0x35f0d bytes) truncating to largest ever: 0x562c57 072000 1713481327.423735 write 0x02f3e6 thru 0x0341e2 (0x4dfd bytes) 074000 1713481334.249552 write 0x48f603 thru 0x4907bb (0x11b9 bytes) 077000 1713481344.950253 mapread 0x022315 thru 0x027264 (0x4f50 bytes) 078000 1713481349.415631 read 0x223c43 thru 0x22d8fc (0x9cba bytes) 079000 1713481352.805095 mapread 0x1daf13 thru 0x1e45d0 (0x96be bytes) 080000 1713481357.030904 mapwrite 0x1c17b9 thru 0x1cdbe4 (0xc42c bytes) 082000 1713481364.457222 read 0x4acb50 thru 0x4bba24 (0xeed5 bytes) 083000 1713481369.550466 mapread 0x063e45 thru 0x06572b (0x18e7 bytes) 084000 1713481374.012501 mapwrite 0x36c951 thru 0x37ae09 (0xe4b9 bytes) 086000 1713481381.610408 read 0x0a5526 thru 0x0a8641 (0x311c bytes) 091000 1713481397.092042 read 0x4e4c84 thru 0x4e5d6f (0x10ec bytes) 092000 1713481400.482412 trunc from 0x41fddd to 0x538b48 (0x118d6c bytes) 093000 1713481404.172873 trunc from 0x3e6fc7 to 0x19280f (0x2547b7 bytes) 094000 1713481408.592744 trunc from 0x4ff71e to 0x4e92b1 (0x1646c bytes) 095000 1713481411.385576 mapread 0x0f5a06 thru 0x0f781e (0x1e19 bytes) 097000 1713481418.685284 mapread 0x2b5894 thru 0x2ba3ea (0x4b57 bytes) 099000 1713481427.431150 read 0x2c4dd7 thru 0x2d1592 (0xc7bc bytes) 100000 1713481431.913276 mapwrite 0x367d72 thru 0x375c6a (0xdef9 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (394s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 19:03:55 (1713481435) fallocate on zfs doesn't consume space fallocate not supported Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x149b3b truncating to largest ever: 0x523479 truncating to largest ever: 0x5235fe 003000 1713481446.606768 write 0x3cc738 thru 0x3d4ee8 (0x87b1 bytes) 005000 1713481456.830463 trunc from 0x3e2556 to 0x17e9f1 (0x263b64 bytes) 006000 1713481461.974235 mapwrite 0x35676a thru 0x35f04d (0x88e4 bytes) truncating to largest ever: 0x527de2 010000 1713481479.129043 mapread 0x071c95 thru 0x07a31c (0x8688 bytes) 011000 1713481483.247518 mapread 0x0a2256 thru 0x0a47b3 (0x255e bytes) 015000 1713481500.752448 read 0x1605e9 thru 0x1632d4 (0x2cec bytes) 016000 1713481505.679260 trunc from 0x51af14 to 0x2c4cb3 (0x256260 bytes) 018000 1713481514.692289 mapread 0x421a75 thru 0x424cf1 (0x327d bytes) 020000 1713481525.798619 write 0x38e7f4 thru 0x38f0d5 (0x8e2 bytes) 021000 1713481530.751904 write 0x4491ab thru 0x454c50 (0xbaa6 bytes) 023000 1713481541.493710 read 0x1e4eb9 thru 0x1ed902 (0x8a4a bytes) 024000 1713481547.989603 trunc from 0x36df6e to 0x0db65a (0x292913 bytes) 028000 1713481568.317538 trunc from 0x4a8554 to 0x2dec4a (0x1c9909 bytes) 030000 1713481578.122150 read 0x1c71c5 thru 0x1c9e33 (0x2c6f bytes) 033000 1713481595.262908 mapwrite 0x1f510a thru 0x1f7792 (0x2689 bytes) 036000 1713481612.179191 read 0x06bcaa thru 0x07568a (0x99e1 bytes) 037000 1713481617.294652 read 0x3257bc thru 0x330f70 (0xb7b5 bytes) 041000 1713481638.833283 mapread 0x008692 thru 0x014a68 (0xc3d7 bytes) 042000 1713481645.242888 trunc from 0x241dee to 0x506c06 (0x2c4e19 bytes) 045000 1713481662.579139 read 0x1d3254 thru 0x1d3b00 (0x8ad bytes) 046000 1713481667.460189 mapwrite 0x1954f4 thru 0x19d599 (0x80a6 bytes) 047000 1713481672.114883 read 0x101146 thru 0x1071ed (0x60a8 bytes) 050000 1713481683.828250 mapread 0x24ee09 thru 0x25ac54 (0xbe4c bytes) 052000 1713481689.784534 trunc from 0x527398 to 0x127097 (0x400300 bytes) 054000 1713481699.208177 mapread 0x4001d7 thru 0x40bf20 (0xbd4a bytes) 055000 1713481704.842386 write 0x15229a thru 0x15a799 (0x8500 bytes) truncating to largest ever: 0x527eca 065000 1713481746.235419 mapwrite 0x033811 thru 0x03849f (0x4c8f bytes) 068000 1713481760.017425 trunc from 0x148cd2 to 0x2a26f5 (0x159a24 bytes) skipping zero size read 069000 1713481765.102282 read 0x30dee1 thru 0x30e6f6 (0x816 bytes) 070000 1713481770.258879 trunc from 0x41f9a8 to 0x46b73f (0x4bd98 bytes) 071000 1713481775.590581 trunc from 0x15c8a7 to 0x08d553 (0xcf353 bytes) 074000 1713481791.426482 trunc from 0x3c0cc6 to 0x4372cd (0x76608 bytes) 075000 1713481795.905632 read 0x19f3cc thru 0x1a660f (0x7244 bytes) truncating to largest ever: 0x5280c8 078000 1713481811.102338 mapwrite 0x46ab1e thru 0x46b099 (0x57c bytes) 079000 1713481816.627775 write 0x1de4a8 thru 0x1df8a1 (0x13fa bytes) 082000 1713481832.940323 read 0x02f703 thru 0x0382c3 (0x8bc1 bytes) 085000 1713481849.760550 write 0x12913d thru 0x12be90 (0x2d54 bytes) 086000 1713481855.379374 mapwrite 0x4b84f8 thru 0x4b8aa7 (0x5b0 bytes) skipping zero size read 089000 1713481871.751509 mapread 0x1783e1 thru 0x178b21 (0x741 bytes) skipping zero size read 094000 1713481895.426080 write 0x3b6f7b thru 0x3b97ff (0x2885 bytes) 095000 1713481899.570527 mapwrite 0x0e5d59 thru 0x0f132c (0xb5d4 bytes) 097000 1713481908.866603 mapwrite 0x258271 thru 0x266d67 (0xeaf7 bytes) 099000 1713481920.136974 trunc from 0x4deaa2 to 0x50a6b6 (0x2bc15 bytes) All operations completed A-OK! PASS fsx_partial_punch (491s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-benchmark test complete, duration 1271 sec ===== 19:12:07 (1713481927) === sanity-benchmark: start cleanup 19:12:07 (1713481927) === === sanity-benchmark: finish cleanup 19:12:08 (1713481928) ===