-----============= acceptance-small: sanity-benchmark ============----- Wed Apr 17 17:01:43 EDT 2024 excepting tests: skipping tests SLOW=no: iozone oleg229-client.virtnet: executing check_config_client /mnt/lustre oleg229-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg229-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6140000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6140000.idle_timeout=debug disable quota as required oleg229-server: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 osd-ldiskfs.track_declares_assert=1 == sanity-benchmark test dbench: dbench ================== 17:01:57 (1713387717) debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7444] debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [bash] [rundbench] [-D] [/mnt/lustre/d0.oleg229-client.virtnet] [20] [-t] [120] looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' running 'dbench 20 -t 120' on /mnt/lustre/d0.oleg229-client.virtnet at Wed Apr 17 17:01:58 EDT 2024 waiting for dbench pid 9587 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 120 seconds with load 'client.txt' and minimum warmup 24 secs failed to create barrier semaphore 19 of 20 processes prepared for launch 0 sec 20 of 20 processes prepared for launch 0 sec releasing clients 20 236 180.57 MB/sec warmup 1 sec latency 43.990 ms 20 553 190.20 MB/sec warmup 2 sec latency 37.052 ms 20 769 142.43 MB/sec warmup 3 sec latency 449.499 ms 20 1162 115.05 MB/sec warmup 4 sec latency 19.619 ms 20 1622 104.67 MB/sec warmup 5 sec latency 26.837 ms 20 2074 88.74 MB/sec warmup 6 sec latency 24.661 ms 20 2519 82.23 MB/sec warmup 7 sec latency 19.829 ms 20 3288 87.81 MB/sec warmup 8 sec latency 21.386 ms 20 3812 88.39 MB/sec warmup 9 sec latency 25.810 ms 20 4082 80.18 MB/sec warmup 10 sec latency 49.945 ms 20 4428 74.03 MB/sec warmup 11 sec latency 40.407 ms 20 4859 71.88 MB/sec warmup 12 sec latency 21.029 ms 20 5277 69.79 MB/sec warmup 13 sec latency 22.100 ms 20 5739 65.64 MB/sec warmup 14 sec latency 22.750 ms 20 6246 66.08 MB/sec warmup 15 sec latency 23.390 ms 20 7051 70.67 MB/sec warmup 16 sec latency 22.455 ms 20 7470 69.51 MB/sec warmup 17 sec latency 26.143 ms 20 7788 65.97 MB/sec warmup 18 sec latency 34.463 ms 20 8177 63.99 MB/sec warmup 19 sec latency 22.350 ms 20 8683 64.36 MB/sec warmup 20 sec latency 20.458 ms 20 9138 61.70 MB/sec warmup 21 sec latency 18.964 ms 20 9612 60.85 MB/sec warmup 22 sec latency 18.788 ms 20 10330 63.63 MB/sec warmup 23 sec latency 25.929 ms 20 11190 8.74 MB/sec execute 1 sec latency 38.345 ms 20 11570 12.18 MB/sec execute 2 sec latency 34.164 ms 20 12044 31.55 MB/sec execute 3 sec latency 29.394 ms 20 12486 28.96 MB/sec execute 4 sec latency 20.076 ms 20 13038 29.55 MB/sec execute 5 sec latency 16.783 ms 20 13722 44.60 MB/sec execute 6 sec latency 22.113 ms 20 14404 53.99 MB/sec execute 7 sec latency 18.751 ms 20 14728 48.86 MB/sec execute 8 sec latency 32.840 ms 20 15063 44.88 MB/sec execute 9 sec latency 50.349 ms 20 15498 45.34 MB/sec execute 10 sec latency 20.289 ms 20 15934 45.14 MB/sec execute 11 sec latency 23.582 ms 20 16402 42.81 MB/sec execute 12 sec latency 16.632 ms 20 16939 45.43 MB/sec execute 13 sec latency 21.734 ms 20 17639 50.35 MB/sec execute 14 sec latency 28.239 ms 20 18076 51.23 MB/sec execute 15 sec latency 20.359 ms 20 18406 48.56 MB/sec execute 16 sec latency 36.580 ms 20 18810 47.49 MB/sec execute 17 sec latency 30.354 ms 20 19284 48.48 MB/sec execute 18 sec latency 20.118 ms 20 19723 46.50 MB/sec execute 19 sec latency 23.824 ms 20 20261 46.48 MB/sec execute 20 sec latency 19.289 ms 20 20938 49.74 MB/sec execute 21 sec latency 23.279 ms 20 21520 51.82 MB/sec execute 22 sec latency 20.437 ms 20 21824 50.29 MB/sec execute 23 sec latency 43.388 ms 20 22195 48.82 MB/sec execute 24 sec latency 46.311 ms 20 22623 48.76 MB/sec execute 25 sec latency 21.422 ms 20 23079 48.57 MB/sec execute 26 sec latency 19.550 ms 20 23563 47.44 MB/sec execute 27 sec latency 18.084 ms 20 24105 48.74 MB/sec execute 28 sec latency 20.985 ms 20 24830 51.23 MB/sec execute 29 sec latency 21.953 ms 20 25225 51.17 MB/sec execute 30 sec latency 29.341 ms 20 25565 49.80 MB/sec execute 31 sec latency 43.937 ms 20 25960 49.24 MB/sec execute 32 sec latency 25.461 ms 20 26438 49.67 MB/sec execute 33 sec latency 23.322 ms 20 26856 48.52 MB/sec execute 34 sec latency 21.903 ms 20 27390 48.56 MB/sec execute 35 sec latency 18.465 ms 20 28094 50.63 MB/sec execute 36 sec latency 19.334 ms 20 28660 51.59 MB/sec execute 37 sec latency 20.663 ms 20 28997 50.61 MB/sec execute 38 sec latency 40.273 ms 20 29381 49.81 MB/sec execute 39 sec latency 59.931 ms 20 29865 50.18 MB/sec execute 40 sec latency 21.060 ms 20 30328 49.53 MB/sec execute 41 sec latency 18.990 ms 20 30866 49.33 MB/sec execute 42 sec latency 16.065 ms 20 31533 50.86 MB/sec execute 43 sec latency 20.228 ms 20 32146 51.92 MB/sec execute 44 sec latency 23.416 ms 20 32461 51.20 MB/sec execute 45 sec latency 43.786 ms 20 32791 50.34 MB/sec execute 46 sec latency 32.811 ms 20 33218 50.31 MB/sec execute 47 sec latency 23.051 ms 20 33670 50.19 MB/sec execute 48 sec latency 22.113 ms 20 34111 49.48 MB/sec execute 49 sec latency 20.718 ms 20 34609 49.71 MB/sec execute 50 sec latency 23.110 ms 20 35335 51.14 MB/sec execute 51 sec latency 18.894 ms 20 35806 51.53 MB/sec execute 52 sec latency 22.172 ms 20 36078 50.71 MB/sec execute 53 sec latency 63.387 ms 20 36453 50.11 MB/sec execute 54 sec latency 26.247 ms 20 36911 50.26 MB/sec execute 55 sec latency 21.190 ms 20 37354 49.89 MB/sec execute 56 sec latency 23.803 ms 20 37854 49.50 MB/sec execute 57 sec latency 15.629 ms 20 38524 50.64 MB/sec execute 58 sec latency 19.347 ms 20 39154 51.56 MB/sec execute 59 sec latency 21.440 ms 20 39490 51.12 MB/sec execute 60 sec latency 23.165 ms 20 39794 50.41 MB/sec execute 61 sec latency 33.426 ms 20 40156 50.06 MB/sec execute 62 sec latency 27.266 ms 20 40612 50.29 MB/sec execute 63 sec latency 21.769 ms 20 41079 49.71 MB/sec execute 64 sec latency 19.337 ms 20 41605 49.75 MB/sec execute 65 sec latency 17.341 ms 20 42295 50.77 MB/sec execute 66 sec latency 20.749 ms 20 42866 51.38 MB/sec execute 67 sec latency 19.342 ms 20 43165 50.77 MB/sec execute 68 sec latency 42.996 ms 20 43544 50.29 MB/sec execute 69 sec latency 73.668 ms 20 44040 50.58 MB/sec execute 70 sec latency 23.117 ms 20 44479 50.13 MB/sec execute 71 sec latency 18.571 ms 20 45027 49.99 MB/sec execute 72 sec latency 15.641 ms 20 45707 50.94 MB/sec execute 73 sec latency 24.326 ms 20 46337 51.56 MB/sec execute 74 sec latency 19.749 ms 20 46656 51.12 MB/sec execute 75 sec latency 36.967 ms 20 47069 50.68 MB/sec execute 76 sec latency 20.788 ms 20 47538 50.76 MB/sec execute 77 sec latency 19.571 ms 20 48000 50.53 MB/sec execute 78 sec latency 18.601 ms 20 48513 50.31 MB/sec execute 79 sec latency 17.771 ms 20 49125 51.02 MB/sec execute 80 sec latency 24.237 ms 20 49801 51.72 MB/sec execute 81 sec latency 19.466 ms 20 50134 51.40 MB/sec execute 82 sec latency 32.052 ms 20 50519 50.95 MB/sec execute 83 sec latency 25.041 ms 20 50936 50.86 MB/sec execute 84 sec latency 24.242 ms 20 51391 50.83 MB/sec execute 85 sec latency 21.828 ms 20 51890 50.48 MB/sec execute 86 sec latency 23.617 ms 20 52465 50.82 MB/sec execute 87 sec latency 19.836 ms 20 53147 51.55 MB/sec execute 88 sec latency 23.300 ms 20 53601 51.62 MB/sec execute 89 sec latency 20.025 ms 20 53928 51.15 MB/sec execute 90 sec latency 32.720 ms 20 54338 50.95 MB/sec execute 91 sec latency 23.809 ms 20 54792 51.00 MB/sec execute 92 sec latency 20.541 ms 20 55226 50.66 MB/sec execute 93 sec latency 19.439 ms 20 55749 50.65 MB/sec execute 94 sec latency 20.599 ms 20 56464 51.39 MB/sec execute 95 sec latency 20.566 ms 20 57008 51.72 MB/sec execute 96 sec latency 20.505 ms 20 57336 51.36 MB/sec execute 97 sec latency 35.546 ms 20 57744 51.05 MB/sec execute 98 sec latency 23.844 ms 20 58199 51.07 MB/sec execute 99 sec latency 50.041 ms 20 58684 50.90 MB/sec execute 100 sec latency 21.067 ms 20 59197 50.83 MB/sec execute 101 sec latency 17.769 ms 20 59843 51.32 MB/sec execute 102 sec latency 18.663 ms 20 60463 51.80 MB/sec execute 103 sec latency 23.058 ms 20 60822 51.57 MB/sec execute 104 sec latency 31.644 ms 20 61201 51.22 MB/sec execute 105 sec latency 26.520 ms 20 61628 51.18 MB/sec execute 106 sec latency 21.394 ms 20 62106 51.12 MB/sec execute 107 sec latency 19.534 ms 20 62616 50.91 MB/sec execute 108 sec latency 22.343 ms 20 63177 51.23 MB/sec execute 109 sec latency 24.126 ms 20 63818 51.73 MB/sec execute 110 sec latency 30.741 ms 20 64236 51.71 MB/sec execute 111 sec latency 28.611 ms 20 64569 51.36 MB/sec execute 112 sec latency 32.612 ms 20 64962 51.17 MB/sec execute 113 sec latency 31.333 ms 20 65427 51.22 MB/sec execute 114 sec latency 32.119 ms 20 65923 50.97 MB/sec execute 115 sec latency 21.120 ms 20 66536 51.16 MB/sec execute 116 sec latency 16.866 ms 20 67271 51.76 MB/sec execute 117 sec latency 26.760 ms 20 67755 51.88 MB/sec execute 118 sec latency 23.096 ms 20 68098 51.54 MB/sec execute 119 sec latency 33.397 ms 20 cleanup 120 sec 0 cleanup 120 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 200424 6.941 63.380 Close 146562 1.611 16.233 Rename 8429 9.745 32.108 Unlink 41038 2.343 34.228 Qpathinfo 181004 1.584 33.622 Qfileinfo 31288 0.058 6.895 Qfsinfo 33249 0.025 7.665 Sfileinfo 16417 5.018 18.729 Find 69813 0.350 26.482 WriteX 98319 0.935 24.820 ReadX 310548 0.011 6.913 LockX 640 1.716 5.840 UnlockX 640 1.725 7.082 Flush 14204 6.633 73.660 Throughput 51.5415 MB/sec 20 clients 20 procs max_latency=73.668 ms stopping dbench on /mnt/lustre/d0.oleg229-client.virtnet at Wed Apr 17 17:04:23 EDT 2024 with return code 0 clean dbench files on /mnt/lustre/d0.oleg229-client.virtnet /mnt/lustre/d0.oleg229-client.virtnet /mnt/lustre/d0.oleg229-client.virtnet removed directory: 'clients/client11/~dmtmp/WORD' removed directory: 'clients/client11/~dmtmp/WORDPRO' removed directory: 'clients/client11/~dmtmp/ACCESS' removed directory: 'clients/client11/~dmtmp/PARADOX' removed directory: 'clients/client11/~dmtmp/PM' removed directory: 'clients/client11/~dmtmp/SEED' removed directory: 'clients/client11/~dmtmp/PWRPNT' removed directory: 'clients/client11/~dmtmp/COREL' removed directory: 'clients/client11/~dmtmp/EXCEL' removed directory: 'clients/client11/~dmtmp' removed directory: 'clients/client11' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client3/~dmtmp/WORD' removed directory: 'clients/client3/~dmtmp/WORDPRO' removed directory: 'clients/client3/~dmtmp/ACCESS' removed directory: 'clients/client3/~dmtmp/PARADOX' removed directory: 'clients/client3/~dmtmp/PM' removed directory: 'clients/client3/~dmtmp/SEED' removed directory: 'clients/client3/~dmtmp/PWRPNT' removed directory: 'clients/client3/~dmtmp/COREL' removed directory: 'clients/client3/~dmtmp/EXCEL' removed directory: 'clients/client3/~dmtmp' removed directory: 'clients/client3' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client16/~dmtmp/WORDPRO' removed directory: 'clients/client16/~dmtmp/COREL' removed directory: 'clients/client16/~dmtmp/PM' removed directory: 'clients/client16/~dmtmp/SEED' removed directory: 'clients/client16/~dmtmp/ACCESS' removed directory: 'clients/client16/~dmtmp/PARADOX' removed directory: 'clients/client16/~dmtmp/WORD' removed directory: 'clients/client16/~dmtmp/PWRPNT' removed directory: 'clients/client16/~dmtmp/EXCEL' removed directory: 'clients/client16/~dmtmp' removed directory: 'clients/client16' removed directory: 'clients/client8/~dmtmp/WORDPRO' removed directory: 'clients/client8/~dmtmp/COREL' removed directory: 'clients/client8/~dmtmp/PM' removed directory: 'clients/client8/~dmtmp/SEED' removed directory: 'clients/client8/~dmtmp/ACCESS' removed directory: 'clients/client8/~dmtmp/PARADOX' removed directory: 'clients/client8/~dmtmp/WORD' removed directory: 'clients/client8/~dmtmp/PWRPNT' removed directory: 'clients/client8/~dmtmp/EXCEL' removed directory: 'clients/client8/~dmtmp' removed directory: 'clients/client8' removed directory: 'clients/client17/~dmtmp/WORDPRO' removed directory: 'clients/client17/~dmtmp/COREL' removed directory: 'clients/client17/~dmtmp/PM' removed directory: 'clients/client17/~dmtmp/SEED' removed directory: 'clients/client17/~dmtmp/ACCESS' removed directory: 'clients/client17/~dmtmp/PARADOX' removed directory: 'clients/client17/~dmtmp/WORD' removed directory: 'clients/client17/~dmtmp/PWRPNT' removed directory: 'clients/client17/~dmtmp/EXCEL' removed directory: 'clients/client17/~dmtmp' removed directory: 'clients/client17' removed directory: 'clients/client5/~dmtmp/WORD' removed directory: 'clients/client5/~dmtmp/WORDPRO' removed directory: 'clients/client5/~dmtmp/ACCESS' removed directory: 'clients/client5/~dmtmp/PARADOX' removed directory: 'clients/client5/~dmtmp/PM' removed directory: 'clients/client5/~dmtmp/SEED' removed directory: 'clients/client5/~dmtmp/PWRPNT' removed directory: 'clients/client5/~dmtmp/COREL' removed directory: 'clients/client5/~dmtmp/EXCEL' removed directory: 'clients/client5/~dmtmp' removed directory: 'clients/client5' removed directory: 'clients/client6/~dmtmp/WORDPRO' removed directory: 'clients/client6/~dmtmp/COREL' removed directory: 'clients/client6/~dmtmp/PM' removed directory: 'clients/client6/~dmtmp/SEED' removed directory: 'clients/client6/~dmtmp/ACCESS' removed directory: 'clients/client6/~dmtmp/PARADOX' removed directory: 'clients/client6/~dmtmp/WORD' removed directory: 'clients/client6/~dmtmp/PWRPNT' removed directory: 'clients/client6/~dmtmp/EXCEL' removed directory: 'clients/client6/~dmtmp' removed directory: 'clients/client6' removed directory: 'clients/client15/~dmtmp/WORD' removed directory: 'clients/client15/~dmtmp/WORDPRO' removed directory: 'clients/client15/~dmtmp/ACCESS' removed directory: 'clients/client15/~dmtmp/PARADOX' removed directory: 'clients/client15/~dmtmp/PM' removed directory: 'clients/client15/~dmtmp/SEED' removed directory: 'clients/client15/~dmtmp/PWRPNT' removed directory: 'clients/client15/~dmtmp/COREL' removed directory: 'clients/client15/~dmtmp/EXCEL' removed directory: 'clients/client15/~dmtmp' removed directory: 'clients/client15' removed directory: 'clients/client12/~dmtmp/WORD' removed directory: 'clients/client12/~dmtmp/WORDPRO' removed directory: 'clients/client12/~dmtmp/ACCESS' removed directory: 'clients/client12/~dmtmp/PARADOX' removed directory: 'clients/client12/~dmtmp/PM' removed directory: 'clients/client12/~dmtmp/SEED' removed directory: 'clients/client12/~dmtmp/PWRPNT' removed directory: 'clients/client12/~dmtmp/COREL' removed directory: 'clients/client12/~dmtmp/EXCEL' removed directory: 'clients/client12/~dmtmp' removed directory: 'clients/client12' removed directory: 'clients/client9/~dmtmp/WORDPRO' removed directory: 'clients/client9/~dmtmp/COREL' removed directory: 'clients/client9/~dmtmp/PM' removed directory: 'clients/client9/~dmtmp/SEED' removed directory: 'clients/client9/~dmtmp/ACCESS' removed directory: 'clients/client9/~dmtmp/PARADOX' removed directory: 'clients/client9/~dmtmp/WORD' removed directory: 'clients/client9/~dmtmp/PWRPNT' removed directory: 'clients/client9/~dmtmp/EXCEL' removed directory: 'clients/client9/~dmtmp' removed directory: 'clients/client9' removed directory: 'clients/client7/~dmtmp/WORDPRO' removed directory: 'clients/client7/~dmtmp/COREL' removed directory: 'clients/client7/~dmtmp/PM' removed directory: 'clients/client7/~dmtmp/SEED' removed directory: 'clients/client7/~dmtmp/ACCESS' removed directory: 'clients/client7/~dmtmp/PARADOX' removed directory: 'clients/client7/~dmtmp/WORD' removed directory: 'clients/client7/~dmtmp/PWRPNT' removed directory: 'clients/client7/~dmtmp/EXCEL' removed directory: 'clients/client7/~dmtmp' removed directory: 'clients/client7' removed directory: 'clients/client13/~dmtmp/WORD' removed directory: 'clients/client13/~dmtmp/WORDPRO' removed directory: 'clients/client13/~dmtmp/ACCESS' removed directory: 'clients/client13/~dmtmp/PARADOX' removed directory: 'clients/client13/~dmtmp/PM' removed directory: 'clients/client13/~dmtmp/SEED' removed directory: 'clients/client13/~dmtmp/PWRPNT' removed directory: 'clients/client13/~dmtmp/COREL' removed directory: 'clients/client13/~dmtmp/EXCEL' removed directory: 'clients/client13/~dmtmp' removed directory: 'clients/client13' removed directory: 'clients/client14/~dmtmp/WORD' removed directory: 'clients/client14/~dmtmp/WORDPRO' removed directory: 'clients/client14/~dmtmp/ACCESS' removed directory: 'clients/client14/~dmtmp/PARADOX' removed directory: 'clients/client14/~dmtmp/PM' removed directory: 'clients/client14/~dmtmp/SEED' removed directory: 'clients/client14/~dmtmp/PWRPNT' removed directory: 'clients/client14/~dmtmp/COREL' removed directory: 'clients/client14/~dmtmp/EXCEL' removed directory: 'clients/client14/~dmtmp' removed directory: 'clients/client14' removed directory: 'clients/client4/~dmtmp/WORD' removed directory: 'clients/client4/~dmtmp/WORDPRO' removed directory: 'clients/client4/~dmtmp/ACCESS' removed directory: 'clients/client4/~dmtmp/PARADOX' removed directory: 'clients/client4/~dmtmp/PM' removed directory: 'clients/client4/~dmtmp/SEED' removed directory: 'clients/client4/~dmtmp/PWRPNT' removed directory: 'clients/client4/~dmtmp/COREL' removed directory: 'clients/client4/~dmtmp/EXCEL' removed directory: 'clients/client4/~dmtmp' removed directory: 'clients/client4' removed directory: 'clients/client18/~dmtmp/WORD' removed directory: 'clients/client18/~dmtmp/WORDPRO' removed directory: 'clients/client18/~dmtmp/ACCESS' removed directory: 'clients/client18/~dmtmp/PARADOX' removed directory: 'clients/client18/~dmtmp/PM' removed directory: 'clients/client18/~dmtmp/SEED' removed directory: 'clients/client18/~dmtmp/PWRPNT' removed directory: 'clients/client18/~dmtmp/COREL' removed directory: 'clients/client18/~dmtmp/EXCEL' removed directory: 'clients/client18/~dmtmp' removed directory: 'clients/client18' removed directory: 'clients/client2/~dmtmp/WORDPRO' removed directory: 'clients/client2/~dmtmp/COREL' removed directory: 'clients/client2/~dmtmp/PM' removed directory: 'clients/client2/~dmtmp/SEED' removed directory: 'clients/client2/~dmtmp/ACCESS' removed directory: 'clients/client2/~dmtmp/PARADOX' removed directory: 'clients/client2/~dmtmp/WORD' removed directory: 'clients/client2/~dmtmp/PWRPNT' removed directory: 'clients/client2/~dmtmp/EXCEL' removed directory: 'clients/client2/~dmtmp' removed directory: 'clients/client2' removed directory: 'clients/client19/~dmtmp/WORDPRO' removed directory: 'clients/client19/~dmtmp/COREL' removed directory: 'clients/client19/~dmtmp/PM' removed directory: 'clients/client19/~dmtmp/SEED' removed directory: 'clients/client19/~dmtmp/ACCESS' removed directory: 'clients/client19/~dmtmp/PARADOX' removed directory: 'clients/client19/~dmtmp/WORD' removed directory: 'clients/client19/~dmtmp/PWRPNT' removed directory: 'clients/client19/~dmtmp/EXCEL' removed directory: 'clients/client19/~dmtmp' removed directory: 'clients/client19' removed directory: 'clients/client10/~dmtmp/WORD' removed directory: 'clients/client10/~dmtmp/WORDPRO' removed directory: 'clients/client10/~dmtmp/ACCESS' removed directory: 'clients/client10/~dmtmp/PARADOX' removed directory: 'clients/client10/~dmtmp/PM' removed directory: 'clients/client10/~dmtmp/SEED' removed directory: 'clients/client10/~dmtmp/PWRPNT' removed directory: 'clients/client10/~dmtmp/COREL' removed directory: 'clients/client10/~dmtmp/EXCEL' removed directory: 'clients/client10/~dmtmp' removed directory: 'clients/client10' removed directory: 'clients' removed 'client.txt' /mnt/lustre/d0.oleg229-client.virtnet dbench successfully finished debug=0x33f0484 PASS dbench (149s) == sanity-benchmark test bonnie: bonnie++ ================ 17:04:26 (1713387866) min OST has 3356784kB available, using 5035176kB file size debug=0 running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7444] running as uid/gid/euid/egid 500/500/500/500, groups: [bonnie++] [-f] [-r] [0] [-s4917] [-n] [10] [-u500:500] [-d/mnt/lustre/d0.bonnie] Using uid:500, gid:500. Writing intelligently...done Rewriting...done Reading intelligently...done start 'em...done...done...done...done...done... Create files in sequential order...done. Stat files in sequential order...done. Delete files in sequential order...done. Create files in random order...done. Stat files in random order...done. Delete files in random order...done. Version 1.97 ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP oleg229-clien 4917M 142783 98 131218 98 293998 68 6468 316 Latency 5561us 42869us 46554us 4232us Version 1.97 ------Sequential Create------ --------Random Create-------- oleg229-client.virt -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 10 377 16 4131 18 614 14 270 16 307 14 752 15 Latency 28466us 6768us 47006us 19154us 19533us 20053us 1.97,1.97,oleg229-client.virtnet,1,1713377505,4917M,,,,142783,98,131218,98,,,293998,68,6468,316,10,,,,,377,16,4131,18,614,14,270,16,307,14,752,15,,5561us,42869us,,46554us,4232us,28466us,6768us,47006us,19154us,19533us,20053us debug=0x33f0484 PASS bonnie (229s) SKIP: sanity-benchmark test_iozone skipping SLOW test iozone == sanity-benchmark test fsx: fsx ======================== 17:08:15 (1713388095) keep default fallocate mode: 0 debug=0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 4405 -P /tmp -l 5408064 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 4405 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero length punch hole truncating to largest ever: 0x3b1b44 truncating to largest ever: 0x4b3a0f fallocating to largest ever: 0x4da862 truncating to largest ever: 0x500b95 truncating to largest ever: 0x5274d2 001000 1713388099.257568 punch from 0x3cb3f8 to 0x3d579e (0xa3a7 bytes) fallocating to largest ever: 0x528540 003000 1713388104.200465 trunc from 0x4ef4b0 to 0x05068c (0x49ee23 bytes) 004000 1713388106.643004 mapwrite 0x07cccb thru 0x08cc2e (0xff64 bytes) 005000 1713388108.853690 write 0x217702 thru 0x21a4e5 (0x2de4 bytes) 006000 1713388110.942575 punch from 0x04b728 to 0x04da80 (0x2359 bytes) 007000 1713388113.294429 trunc from 0x306351 to 0x0ac77f (0x259bd1 bytes) 008000 1713388115.252287 punch from 0x09860e to 0x09f70a (0x70fd bytes) 010000 1713388119.783335 read 0x262f50 thru 0x26f263 (0xc314 bytes) 011000 1713388121.801297 mapread 0x1ca947 thru 0x1d7bad (0xd267 bytes) 012000 1713388124.065919 trunc from 0x528540 to 0x1dec8e (0x3498b1 bytes) 014000 1713388128.906215 trunc from 0x44200b to 0x33ca00 (0x10560a bytes) 015000 1713388131.185211 trunc from 0x14975d to 0x36096e (0x217212 bytes) 016000 1713388133.328745 fallocate 0x4f1afc thru 0x4f6b30 (0x5035 bytes) 019000 1713388139.764769 read 0x04a6f7 thru 0x04ee47 (0x4751 bytes) 020000 1713388141.966898 read 0x2c3ea5 thru 0x2ce2c0 (0xa41c bytes) 022000 1713388145.777098 read 0x3f4d7f thru 0x3fd8a4 (0x8b26 bytes) 023000 1713388147.775849 mapread 0x2e2dc0 thru 0x2f2108 (0xf349 bytes) 024000 1713388151.659174 punch from 0x2aa146 to 0x2b872c (0xe5e7 bytes) 026000 1713388157.143236 mapwrite 0x347252 thru 0x34dd81 (0x6b30 bytes) 027000 1713388159.375000 fallocate 0x476ff4 thru 0x485334 (0xe341 bytes) 028000 1713388161.534046 punch from 0x20d193 to 0x211484 (0x42f2 bytes) 029000 1713388163.498139 mapread 0x3e548f thru 0x3eaf51 (0x5ac3 bytes) 030000 1713388165.881283 trunc from 0x45565a to 0x301938 (0x153d21 bytes) 032000 1713388170.020468 trunc from 0x20a0d3 to 0x18abea (0x7f4e8 bytes) 035000 1713388176.879909 fallocate 0x26b773 thru 0x27051c (0x4daa bytes) 036000 1713388179.596266 trunc from 0x202a51 to 0x2c4a60 (0xc2010 bytes) 037000 1713388183.847096 read 0x1bd767 thru 0x1c06c1 (0x2f5b bytes) 038000 1713388187.850420 write 0x119f65 thru 0x121048 (0x70e4 bytes) 039000 1713388191.452288 fallocate 0x18de50 thru 0x197c2e (0x9ddf bytes) 040000 1713388196.068423 fallocate 0x292452 thru 0x2953ee (0x2f9d bytes) 041000 1713388199.259374 fallocate 0x0b8167 thru 0x0c17e7 (0x9681 bytes) 042000 1713388202.998730 trunc from 0x2411ee to 0x22ad42 (0x164ab bytes) 043000 1713388207.330593 trunc from 0x23e054 to 0x310418 (0xd23c5 bytes) 044000 1713388212.220897 write 0x1de1a0 thru 0x1e0ece (0x2d2f bytes) 045000 1713388216.665635 punch from 0x07e763 to 0x0860d6 (0x7974 bytes) 046000 1713388220.945534 trunc from 0x4098a3 to 0x29227a (0x177628 bytes) 047000 1713388225.772567 mapwrite 0x1203b8 thru 0x12ff41 (0xfb8a bytes) 048000 1713388229.734873 read 0x1df125 thru 0x1ebc84 (0xcb60 bytes) 050000 1713388238.927440 trunc from 0x491c7d to 0x348b7a (0x149102 bytes) 051000 1713388243.302427 mapread 0x21ff4d thru 0x229477 (0x952b bytes) 052000 1713388247.308205 write 0x1ad874 thru 0x1b8b0d (0xb29a bytes) 053000 1713388251.948615 fallocate 0x3bec55 thru 0x3c0ac6 (0x1e72 bytes) 055000 1713388260.273952 fallocate 0x28edf0 thru 0x299af2 (0xad03 bytes) 056000 1713388264.606307 write 0x1f7418 thru 0x1f8e94 (0x1a7d bytes) 057000 1713388268.741666 write 0x4cd72c thru 0x4d10a5 (0x397a bytes) 058000 1713388272.560018 read 0x0e61f9 thru 0x0f0613 (0xa41b bytes) 059000 1713388276.263809 mapwrite 0x112af8 thru 0x11ca4a (0x9f53 bytes) 060000 1713388279.964376 mapread 0x352ca8 thru 0x355d76 (0x30cf bytes) 061000 1713388284.341725 punch from 0x03cba1 to 0x03e7a5 (0x1c05 bytes) 063000 1713388291.608066 fallocate 0x092145 thru 0x0963f0 (0x42ac bytes) 064000 1713388296.017897 punch from 0x1c8661 to 0x1ce1d8 (0x5b78 bytes) 065000 1713388300.918927 mapwrite 0x500979 thru 0x502d02 (0x238a bytes) 068000 1713388313.362658 mapread 0x145690 thru 0x145cc5 (0x636 bytes) 069000 1713388317.240624 mapread 0x030d65 thru 0x03a0c2 (0x935e bytes) 071000 1713388326.467745 trunc from 0x3c419f to 0x12886b (0x29b933 bytes) 073000 1713388334.374675 mapwrite 0x0d4f95 thru 0x0e0793 (0xb7ff bytes) 074000 1713388338.310393 fallocate 0x325b6c thru 0x32dbce (0x8063 bytes) 075000 1713388342.591547 mapread 0x153732 thru 0x1588f3 (0x51c2 bytes) 077000 1713388351.786416 write 0x01cc9e thru 0x01ea81 (0x1de4 bytes) 078000 1713388356.723470 read 0x12fb2f thru 0x13ed97 (0xf269 bytes) 079000 1713388361.258641 punch from 0x067792 to 0x06821e (0xa8d bytes) 080000 1713388366.202301 read 0x21ef28 thru 0x228316 (0x93ef bytes) 081000 1713388369.838752 fallocate 0x39a041 thru 0x3a991e (0xf8de bytes) 083000 1713388379.197053 mapwrite 0x4bcdc0 thru 0x4c52b6 (0x84f7 bytes) 085000 1713388388.860198 write 0x087f6c thru 0x08d306 (0x539b bytes) 086000 1713388393.320194 mapread 0x3842f0 thru 0x38b3cd (0x70de bytes) 087000 1713388396.495967 mapread 0x351e4c thru 0x35d72b (0xb8e0 bytes) 088000 1713388401.042609 mapread 0x0a467d thru 0x0a9908 (0x528c bytes) 089000 1713388406.005241 mapwrite 0x085e1d thru 0x093b04 (0xdce8 bytes) 091000 1713388415.173199 mapread 0x02818e thru 0x02de3b (0x5cae bytes) 092000 1713388419.882495 punch from 0x2a4eb1 to 0x2a551b (0x66b bytes) 093000 1713388424.111683 read 0x177355 thru 0x178796 (0x1442 bytes) 096000 1713388438.101365 fallocate 0x0ce57d thru 0x0dad0a (0xc78e bytes) 097000 1713388443.244291 punch from 0x2c8739 to 0x2d683e (0xe106 bytes) 098000 1713388447.906568 fallocate 0x3e01ee thru 0x3eb139 (0xaf4c bytes) 099000 1713388452.850877 mapread 0x182feb thru 0x1906b3 (0xd6c9 bytes) All operations completed A-OK! debug=0x33f0484 PASS fsx (363s) == sanity-benchmark test fsx_partial_punch: Verify fsx with partial punch via fallocate ========================================================== 17:14:18 (1713388458) keep default fallocate mode: 0 Using: /home/green/git/lustre-release/lustre/tests/fsx -c 50 -p 1000 -S 7919 -P /tmp -l 5407677 -N 100000 /mnt/lustre/f0.fsxfile Chance of close/open is 1 in 50 Seed set to 7919 fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x26ae1d fallocating to largest ever: 0x31a7d6 truncating to largest ever: 0x46d9b5 fallocating to largest ever: 0x504057 fallocating to largest ever: 0x5283bd 001000 1713388464.688667 punch from 0x462b93 to 0x469c70 (0x70de bytes) 002000 1713388469.255752 read 0x3076b2 thru 0x30886d (0x11bc bytes) 006000 1713388488.856553 read 0x1e2446 thru 0x1ea74d (0x8308 bytes) 007000 1713388492.905049 read 0x332ab7 thru 0x339cb1 (0x71fb bytes) 008000 1713388497.798081 trunc from 0x456755 to 0x461133 (0xa9df bytes) 009000 1713388501.857911 trunc from 0x48c628 to 0x48f1e1 (0x2bba bytes) 010000 1713388506.037136 punch from 0x014891 to 0x019220 (0x4990 bytes) 012000 1713388515.382223 read 0x0f5c9a thru 0x0f9ba1 (0x3f08 bytes) 013000 1713388520.137742 fallocate 0x0f6aff thru 0x0fff0e (0x9410 bytes) 015000 1713388529.977202 mapread 0x12c859 thru 0x12d496 (0xc3e bytes) 016000 1713388535.304751 mapwrite 0x3bf59f thru 0x3ccecd (0xd92f bytes) 018000 1713388545.993784 fallocate 0x227be9 thru 0x22ddef (0x6207 bytes) 019000 1713388550.487419 punch from 0x44bda9 to 0x453488 (0x76e0 bytes) 021000 1713388560.445685 trunc from 0x30d624 to 0x257042 (0xb65e1 bytes) 022000 1713388565.061442 punch from 0x36194d to 0x36e62a (0xccde bytes) 023000 1713388569.492840 fallocate 0x501f50 thru 0x50ad8d (0x8e3e bytes) 024000 1713388574.711154 mapread 0x2772c5 thru 0x2814ed (0xa229 bytes) 025000 1713388579.089665 punch from 0x134d99 to 0x13fd43 (0xafab bytes) 026000 1713388584.205820 write 0x47bc56 thru 0x47f33e (0x36e9 bytes) 027000 1713388588.904310 mapread 0x265489 thru 0x269662 (0x41da bytes) 028000 1713388593.402735 read 0x2756ee thru 0x277d59 (0x266c bytes) 030000 1713388603.079361 write 0x526b72 thru 0x5283bc (0x184b bytes) 031000 1713388608.064477 mapwrite 0x428de4 thru 0x43410c (0xb329 bytes) 032000 1713388612.913405 punch from 0x37a986 to 0x387446 (0xcac1 bytes) 033000 1713388617.565679 trunc from 0x45eecc to 0x021aec (0x43d3df bytes) 034000 1713388622.347938 trunc from 0x33b7b2 to 0x24ae0e (0xf09a3 bytes) 035000 1713388627.030937 trunc from 0x32145e to 0x2d0f63 (0x504fa bytes) 036000 1713388631.662763 fallocate 0x46e859 thru 0x47a568 (0xbd10 bytes) 037000 1713388636.157026 trunc from 0x443d42 to 0x160676 (0x2e36cb bytes) 038000 1713388640.688111 trunc from 0x42f1fe to 0x3e5e05 (0x493f8 bytes) 039000 1713388644.536266 write 0x1c7631 thru 0x1c8c0d (0x15dd bytes) 040000 1713388648.976458 write 0x29fa7d thru 0x2a27e2 (0x2d66 bytes) 042000 1713388658.179343 mapwrite 0x25fc0b thru 0x26c9df (0xcdd5 bytes) 043000 1713388663.305710 trunc from 0x3f18ea to 0x2f06de (0x10120b bytes) 044000 1713388667.752828 trunc from 0x46cd86 to 0x0f4f54 (0x377e31 bytes) 045000 1713388672.602054 punch from 0x182cbb to 0x18aa53 (0x7d99 bytes) 048000 1713388687.852474 trunc from 0x49f78c to 0x37fdc9 (0x11f9c2 bytes) 049000 1713388693.234711 trunc from 0x435e12 to 0x22a928 (0x20b4e9 bytes) 050000 1713388698.220940 write 0x223cac thru 0x22538c (0x16e1 bytes) 051000 1713388703.332027 trunc from 0x39959a to 0x40eafe (0x75565 bytes) 052000 1713388708.067246 punch from 0x16bb31 to 0x1704b0 (0x4980 bytes) 053000 1713388712.893812 write 0x45129a thru 0x45daef (0xc856 bytes) 055000 1713388722.984750 trunc from 0x2f53c4 to 0x32a885 (0x354c2 bytes) 056000 1713388728.010783 trunc from 0x4d74c8 to 0x0c42c9 (0x4131fe bytes) 057000 1713388733.372636 mapread 0x1b7275 thru 0x1c4fdf (0xdd6b bytes) 060000 1713388749.915141 fallocate 0x0fdb77 thru 0x10bc5b (0xe0e5 bytes) 062000 1713388760.890490 trunc from 0x44c5ce to 0x08bbf3 (0x3c09da bytes) 063000 1713388765.950118 mapwrite 0x15ec32 thru 0x16ea7e (0xfe4d bytes) 064000 1713388769.739089 write 0x124dbf thru 0x1312fb (0xc53d bytes) skipping zero length fallocate 066000 1713388779.846946 write 0x490387 thru 0x495596 (0x5210 bytes) 068000 1713388790.966433 punch from 0x0cfe44 to 0x0d8c83 (0x8e40 bytes) 069000 1713388796.673567 write 0x1fb420 thru 0x2050bb (0x9c9c bytes) 070000 1713388802.478501 mapwrite 0x14e621 thru 0x14f5e3 (0xfc3 bytes) 072000 1713388813.893698 mapread 0x0a1b57 thru 0x0a30bb (0x1565 bytes) 073000 1713388818.983859 fallocate 0x4dd792 thru 0x4ec81b (0xf08a bytes) 074000 1713388824.692086 write 0x2b2e85 thru 0x2bd1eb (0xa367 bytes) 075000 1713388829.653557 mapwrite 0x12cdcb thru 0x1385cd (0xb803 bytes) 076000 1713388834.829613 trunc from 0x279168 to 0x144053 (0x135114 bytes) 077000 1713388840.002885 trunc from 0x0f672c to 0x3dc883 (0x2e6158 bytes) 079000 1713388850.683063 fallocate 0x106617 thru 0x10e580 (0x7f6a bytes) 081000 1713388861.468654 trunc from 0x5283bd to 0x4633e6 (0xc4fd6 bytes) 082000 1713388866.440603 mapread 0x2c449e thru 0x2c8a03 (0x4566 bytes) 083000 1713388871.231024 mapwrite 0x0c5b08 thru 0x0cafc3 (0x54bc bytes) 084000 1713388876.996747 punch from 0x382e12 to 0x38e666 (0xb855 bytes) 086000 1713388886.962992 mapread 0x108800 thru 0x10b555 (0x2d56 bytes) 088000 1713388897.482794 trunc from 0x0c248a to 0x44fbd3 (0x38d74a bytes) 090000 1713388908.327445 trunc from 0x4e6c0d to 0x265396 (0x281876 bytes) 091000 1713388913.262387 punch from 0x14933d to 0x14bf0a (0x2bce bytes) 092000 1713388918.380280 trunc from 0x323146 to 0x409aa3 (0xe695e bytes) 093000 1713388923.250410 mapwrite 0x36edc5 thru 0x379fea (0xb226 bytes) 094000 1713388928.372548 mapwrite 0x0070ea thru 0x00d77c (0x6693 bytes) 096000 1713388939.257903 read 0x307e11 thru 0x316661 (0xe851 bytes) 097000 1713388944.372800 write 0x3020c2 thru 0x3045e2 (0x2521 bytes) 098000 1713388949.855357 mapread 0x303964 thru 0x30cfb9 (0x9656 bytes) 100000 1713388960.064928 fallocate 0x424400 thru 0x42b77a (0x737b bytes) All operations completed A-OK! PASS fsx_partial_punch (503s) == sanity-benchmark test complete, duration 1257 sec ===== 17:22:41 (1713388961)