-----============= acceptance-small: sanity-dom ============----- Thu Apr 18 04:40:23 EDT 2024 excepting tests: === sanity-dom: start setup 04:40:27 (1713429627) === Starting client oleg212-client.virtnet: -o user_xattr,flock oleg212-server@tcp:/lustre /mnt/lustre2 Started clients oleg212-client.virtnet: 192.168.202.112@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg212-client.virtnet: executing check_config_client /mnt/lustre oleg212-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg212-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c8e000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b5d3c800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c8e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5d3c800.idle_timeout=debug disable quota as required oleg212-server: oleg212-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity-dom: finish setup 04:40:33 (1713429633) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6922] 192.168.202.112@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 1: write a file on one mount, truncate on the other, write again ========================================================== 04:40:35 (1713429635) 1+0 records in 1+0 records out 7168 bytes (7.2 kB) copied, 0.00373697 s, 1.9 MB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.0044897 s, 684 kB/s /mnt/lustre2/f1.sanity-dom has type file OK /mnt/lustre2/f1.sanity-dom has size 6144 OK PASS 1 (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 2: Write with a seek, append, read from a single mountpoint ========================================================== 04:40:39 (1713429639) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102051 s, 103 MB/s 1+0 records in 1+0 records out 234852 bytes (235 kB) copied, 0.00209751 s, 112 MB/s 0+1 records in 0+1 records out 234852 bytes (235 kB) copied, 0.014486 s, 16.2 MB/s /mnt/lustre/f2.sanity-dom_left has type file OK /mnt/lustre/f2.sanity-dom_left has size 234852 OK PASS 2 (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 3: Truncate over DoM size on different nodes ========================================================== 04:40:43 (1713429643) 1+0 records in 1+0 records out 1048476 bytes (1.0 MB) copied, 0.0100112 s, 105 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00894859 s, 458 kB/s /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049276 OK /mnt/lustre2/f3.sanity-dom has type file OK /mnt/lustre2/f3.sanity-dom has size 1049076 OK /mnt/lustre/f3.sanity-dom has type file OK /mnt/lustre/f3.sanity-dom has size 1049076 OK PASS 3 (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 4: DoM: glimpse doesn't produce duplicated locks ========================================================== 04:40:47 (1713429647) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0281429 s, 74.5 MB/s fail_loc=0x80000808 PASS 4 (3s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 5: DoM truncate deadlock ============== 04:40:52 (1713429652) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00243504 s, 1.7 MB/s multiop /mnt/lustre/f5.sanity-dom vO_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6922 multiop /mnt/lustre/f5.sanity-dom vO_Tc TMPPIPE=/tmp/multiop_open_wait_pipe.6922 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f5.sanity-dom user.job="dd.0" fail_loc=0x80001415 fail_val=5 PASS 5 (4s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 6: Race two writes, check file size === 04:40:58 (1713429658) /mnt/lustre2/f6.sanity-dom has size 500 OK PASS 6 (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test 7: Stale pages after read-on-open ===== 04:41:02 (1713429662) 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00291903 s, 343 kB/s 1+0 records in 1+0 records out 1000 bytes (1.0 kB) copied, 0.00304316 s, 329 kB/s PASS 7 (2s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test fsx: Dual-mount fsx with DoM files ==== 04:41:06 (1713429666) fallocate on zfs doesn't consume space fallocate not supported Chance of close/open is 1 in 50 Seed set to 9667 fd 0: /mnt/lustre/ffsx.sanity-dom fd 1: /mnt/lustre2/ffsx.sanity-dom fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1ff9b5 000001[1] 1713429667.203700 trunc from 00000000 to 0x1ff9b4 (0x1ff9b5 bytes) 1713429667.213949 truncate done 000003[1] 1713429667.220852 trunc from 0x1ff9b5 to 0x103844 (0xfc170 bytes) 1713429667.225692 truncate done 000004[0] 1713429667.231152 mapwrite 0x0d8afc thru 0x0e4e50 (0xc355 bytes) 1713429667.233300 mmap done 1713429667.376428 msync done 1713429667.376553 munmap done 000007[1] 1713429667.393618 mapwrite 0x10d1ae thru 0x1139ac (0x67ff bytes) 1713429667.401292 truncate done 1713429667.401499 mmap done 1713429667.436456 msync done 1713429667.436515 munmap done 000009[1] 1713429667.446145 mapwrite 0x10f31a thru 0x11d687 (0xe36e bytes) 1713429667.451272 truncate done 1713429667.451443 mmap done 1713429667.479930 msync done 1713429667.480003 munmap done 000011[0] 1713429667.491064 read 0x0e6e23 thru 0x0f1c92 (0xae70 bytes) 1713429667.512748 read done 000013[1] 1713429667.523427 trunc from 0x11d688 to 0x078b23 (0xa4b64 bytes) 1713429667.533663 truncate done 000014[1] 1713429667.535548 write 0x092a4a thru 0x09a2e8 (0x789f bytes) 1713429667.536129 write done 000015[1] 1713429667.545994 write 0x049233 thru 0x04d84e (0x461c bytes) 1713429667.549186 write done 000018[0] 1713429667.561225 read 0x088695 thru 0x088ca0 (0x60c bytes) 1713429667.575053 read done 000023[0] 1713429667.584755 mapwrite 0x107f03 thru 0x10ff82 (0x8080 bytes) 1713429667.598016 truncate done 1713429667.598253 mmap done 1713429667.639917 msync done 1713429667.640054 munmap done 000028[0] 1713429667.661579 mapread 0x001d4e thru 0x00cfa0 (0xb253 bytes) 1713429667.661771 mmap done 1713429667.689977 memcpy done 1713429667.690069 munmap done 000030[1] 1713429667.690766 mapwrite 0x1ab209 thru 0x1b22b1 (0x70a9 bytes) 1713429667.703741 truncate done 1713429667.703932 mmap done 1713429667.742529 msync done 1713429667.742729 munmap done 000031[1] 1713429667.745037 mapwrite 0x04aa7f thru 0x052526 (0x7aa8 bytes) 1713429667.745298 mmap done 1713429667.771198 msync done 1713429667.771278 munmap done 000033[1] 1713429667.783363 write 0x158be1 thru 0x165b10 (0xcf30 bytes) 1713429667.784080 write done 000036[0] 1713429667.802761 trunc from 0x1b22b2 to 0x03aa2f (0x177882 bytes) 1713429667.822785 truncate done 000038[0] 1713429667.835956 write 0x0fb24c thru 0x10587a (0xa62f bytes) 1713429667.836959 write done 000039[1] 1713429667.837250 trunc from 0x10587b to 0x12b537 (0x25cbd bytes) 1713429667.863112 truncate done 000041[1] 1713429667.865501 trunc from 0x12b538 to 0x010c6b (0x11a8cc bytes) 1713429667.869425 truncate done 000044[0] 1713429667.881195 mapread 0x00d667 thru 0x010c6b (0x3605 bytes) 1713429667.884189 mmap done 1713429667.896652 memcpy done 1713429667.896845 munmap done 000045[1] 1713429667.902397 write 0x0aca5d thru 0x0afa97 (0x303b bytes) 1713429667.906117 write done 000046[0] 1713429667.911418 trunc from 0x0afa98 to 0x082a2e (0x2d069 bytes) 1713429667.925598 truncate done 000048[1] 1713429667.936282 write 0x0bb19a thru 0x0bbe68 (0xccf bytes) 1713429667.940837 write done 000050[0] 1713429667.954209 read 0x010d8a thru 0x012f44 (0x21bb bytes) 1713429667.974232 read done 000052[1] 1713429667.981122 mapwrite 0x1cf826 thru 0x1d400d (0x47e8 bytes) 1713429667.997817 truncate done 1713429667.998003 mmap done 1713429668.050570 msync done 1713429668.050792 munmap done 000060[1] 1713429668.070817 trunc from 0x1d400e to 0x08d067 (0x146fa6 bytes) 1713429668.075911 truncate done 000061[0] 1713429668.084338 write 0x1ce241 thru 0x1d1f17 (0x3cd7 bytes) 1713429668.088368 write done 000065[0] 1713429668.115548 mapwrite 0x1cdd0b thru 0x1d77f8 (0x9aee bytes) 1713429668.124598 truncate done 1713429668.124763 mmap done 1713429668.173698 msync done 1713429668.173783 munmap done 000066[1] 1713429668.182764 read 0x0aa4ee thru 0x0b5f39 (0xba4c bytes) 1713429668.211358 read done 000068[1] 1713429668.219078 trunc from 0x1d77f9 to 0x10a071 (0xcd787 bytes) 1713429668.232263 truncate done 000070[0] 1713429668.234736 write 0x175fc8 thru 0x17fc2a (0x9c63 bytes) 1713429668.238765 write done 000071[0] 1713429668.243918 read 0x07b86b thru 0x083db3 (0x8549 bytes) 1713429668.257160 read done 000072[0] 1713429668.264761 read 0x10c9a8 thru 0x113b59 (0x71b2 bytes) 1713429668.264892 read done 000073[1] 1713429668.271095 trunc from 0x17fc2b to 0x143c68 (0x3bfc2 bytes) 1713429668.286604 truncate done 000074[1] 1713429668.296454 trunc from 0x143c69 to 0x0e127d (0x629eb bytes) 1713429668.301576 truncate done 000076[1] 1713429668.311794 mapread 0x05f62c thru 0x06213e (0x2b13 bytes) 1713429668.311997 mmap done 1713429668.318913 memcpy done 1713429668.319189 munmap done 000078[0] 1713429668.325105 mapread 0x0aea89 thru 0x0b90aa (0xa622 bytes) 1713429668.327900 mmap done 1713429668.340713 memcpy done 1713429668.340811 munmap done 000081[0] 1713429668.348779 trunc from 0x0e127e to 0x17c492 (0x9b215 bytes) 1713429668.362212 truncate done 000084[0] 1713429668.381825 mapread 0x048a98 thru 0x057b96 (0xf0ff bytes) 1713429668.382052 mmap done 1713429668.424318 memcpy done 1713429668.424514 munmap done 000085[1] 1713429668.427227 read 0x11849f thru 0x124a55 (0xc5b7 bytes) 1713429668.461929 read done 000088[1] 1713429668.477789 trunc from 0x17c493 to 0x0e6358 (0x9613a bytes) 1713429668.490727 truncate done 000089[1] 1713429668.492532 write 0x0c2ca6 thru 0x0c521b (0x2576 bytes) 1713429668.501848 write done 000094[0] 1713429668.509955 read 0x087afe thru 0x096847 (0xed4a bytes) 1713429668.528306 read done 000096[0] 1713429668.541364 mapread 0x012050 thru 0x01d48e (0xb43f bytes) 1713429668.544239 mmap done 1713429668.544352 memcpy done 1713429668.544451 munmap done 000103[0] 1713429668.573735 read 0x00b520 thru 0x00ba74 (0x555 bytes) 1713429668.573832 read done 000105[1] 1713429668.582683 mapread 0x091e19 thru 0x09e236 (0xc41e bytes) 1713429668.582910 mmap done 1713429668.609994 memcpy done 1713429668.610059 munmap done 000106[1] 1713429668.615571 read 0x0c2afb thru 0x0d04be (0xd9c4 bytes) 1713429668.623837 read done 000107[1] 1713429668.629704 mapwrite 0x0b5c67 thru 0x0c46fd (0xea97 bytes) 1713429668.630023 mmap done 1713429668.708291 msync done 1713429668.708562 munmap done 000108[1] 1713429668.708982 read 0x0ce724 thru 0x0dd97e (0xf25b bytes) 1713429668.718917 read done 000111[0] 1713429668.720012 mapwrite 0x042fb5 thru 0x044338 (0x1384 bytes) 1713429668.723375 mmap done 1713429668.768788 msync done 1713429668.768949 munmap done 000114[1] 1713429668.788898 trunc from 0x0e6359 to 0x1a93ce (0xc3076 bytes) 1713429668.800936 truncate done 000115[0] 1713429668.807431 mapwrite 0x19703d thru 0x1a3758 (0xc71c bytes) 1713429668.809841 mmap done 1713429668.867639 msync done 1713429668.867715 munmap done 000117[1] 1713429668.878430 write 0x0b6edf thru 0x0b7be7 (0xd09 bytes) 1713429668.882018 write done 000120[0] 1713429668.899735 mapread 0x02c64a thru 0x03b8aa (0xf261 bytes) 1713429668.903071 mmap done 1713429668.941601 memcpy done 1713429668.941708 munmap done 000123[0] 1713429668.948141 mapread 0x112ba9 thru 0x12130f (0xe767 bytes) 1713429668.948351 mmap done 1713429668.948510 memcpy done 1713429668.948550 munmap done 000124[0] 1713429668.955001 mapwrite 0x1d0b62 thru 0x1d49e4 (0x3e83 bytes) 1713429668.964332 truncate done 1713429668.964544 mmap done 1713429669.010814 msync done 1713429669.010906 munmap done 000130[1] 1713429669.042463 mapwrite 0x00d8cf thru 0x00e977 (0x10a9 bytes) 1713429669.045106 mmap done 1713429669.068435 msync done 1713429669.068595 munmap done 000133[1] 1713429669.089426 read 0x0421ba thru 0x0469cd (0x4814 bytes) 1713429669.100996 read done 000135[1] 1713429669.116935 mapread 0x06e26f thru 0x077797 (0x9529 bytes) 1713429669.120682 mmap done 1713429669.120789 memcpy done 1713429669.120828 munmap done 000137[1] 1713429669.132904 mapwrite 0x17e7c5 thru 0x1804af (0x1ceb bytes) 1713429669.136364 mmap done 1713429669.169216 msync done 1713429669.169274 munmap done 000138[0] 1713429669.176145 write 0x02f4c0 thru 0x03de89 (0xe9ca bytes) 1713429669.185890 write done 000141[1] 1713429669.203887 trunc from 0x1d49e5 to 0x03c9bb (0x198029 bytes) 1713429669.218330 truncate done 000143[0] 1713429669.238990 write 0x1a141d thru 0x1a997a (0x855e bytes) 1713429669.244843 write done 000146[0] 1713429669.274609 write 0x0a8b00 thru 0x0b533d (0xc83e bytes) 1713429669.285696 write done 000148[0] 1713429669.286585 write 0x14625c thru 0x14e4b6 (0x825b bytes) 1713429669.290786 write done 000151[1] 1713429669.299604 mapwrite 0x031da5 thru 0x038851 (0x6aad bytes) 1713429669.304526 mmap done 1713429669.344980 msync done 1713429669.345403 munmap done 000152[1] 1713429669.354053 mapwrite 0x06df69 thru 0x076e35 (0x8ecd bytes) 1713429669.357712 mmap done 1713429669.399657 msync done 1713429669.399738 munmap done 000153[0] 1713429669.405630 mapwrite 0x0e6b07 thru 0x0ec1fc (0x56f6 bytes) 1713429669.409320 mmap done 1713429669.443969 msync done 1713429669.444046 munmap done 000154[0] 1713429669.449146 mapwrite 0x1c6950 thru 0x1d6633 (0xfce4 bytes) 1713429669.457211 truncate done 1713429669.457362 mmap done 1713429669.517565 msync done 1713429669.517678 munmap done 000159[1] 1713429669.530552 read 0x0132d4 thru 0x01c802 (0x952f bytes) 1713429669.544983 read done 000164[0] 1713429669.559336 mapwrite 0x15533c thru 0x1649c6 (0xf68b bytes) 1713429669.559722 mmap done 1713429669.613654 msync done 1713429669.613724 munmap done 000165[0] 1713429669.620653 write 0x08794b thru 0x08b3ef (0x3aa5 bytes) 1713429669.634907 write done 000166[0] 1713429669.635283 trunc from 0x1d6634 to 0x0de4b4 (0xf817f bytes) 1713429669.643956 truncate done 000168[0] 1713429669.647635 mapwrite 0x050f6c thru 0x055746 (0x47db bytes) 1713429669.647848 mmap done 1713429669.683765 msync done 1713429669.683824 munmap done 000172[1] 1713429669.691842 read 0x04860b thru 0x0486fe (0xf4 bytes) 1713429669.703605 read done 000178[1] 1713429669.730086 trunc from 0x0de4b5 to 0x1e74eb (0x109037 bytes) 1713429669.741265 truncate done 000179[1] 1713429669.751844 mapwrite 0x0031b8 thru 0x00be54 (0x8c9d bytes) 1713429669.752158 mmap done 1713429669.801707 msync done 1713429669.802040 munmap done 000181[1] 1713429669.808692 mapread 0x17e20f thru 0x18ceb3 (0xeca5 bytes) 1713429669.808924 mmap done 1713429669.809030 memcpy done 1713429669.809090 munmap done 000185[1] 1713429669.815480 read 0x0c55fb thru 0x0d51ef (0xfbf5 bytes) 1713429669.823648 read done 000186[1] 1713429669.824054 mapwrite 0x156d53 thru 0x1646c4 (0xd972 bytes) 1713429669.824364 mmap done 1713429669.844615 msync done 1713429669.844685 munmap done 000187[0] 1713429669.853617 read 0x0c4319 thru 0x0cad90 (0x6a78 bytes) 1713429669.870127 read done 000188[1] 1713429669.872295 write 0x18c037 thru 0x194d59 (0x8d23 bytes) 1713429669.872919 write done 000189[1] 1713429669.873738 write 0x1fab63 thru 0x1fffff (0x549d bytes) 1713429669.874268 write done 000190[1] 1713429669.885572 trunc from 0x200000 to 0x1184da (0xe7b25 bytes) 1713429669.902111 truncate done 000191[0] 1713429669.910346 mapwrite 0x1ae839 thru 0x1af03a (0x802 bytes) 1713429669.923064 truncate done 1713429669.923274 mmap done 1713429669.963527 msync done 1713429669.963604 munmap done 000192[1] 1713429669.973460 mapwrite 0x0e16e8 thru 0x0e369a (0x1fb3 bytes) 1713429669.976740 mmap done 1713429670.035613 msync done 1713429670.035675 munmap done 000194[1] 1713429670.051992 write 0x0af99f thru 0x0b906c (0x96ce bytes) 1713429670.056282 write done 000196[1] 1713429670.066627 write 0x1f55ea thru 0x1fffff (0xaa16 bytes) 1713429670.074933 write done 000197[0] 1713429670.075526 read 0x156b49 thru 0x164161 (0xd619 bytes) 1713429670.111271 read done 000198[1] 1713429670.119550 write 0x021afc thru 0x02fe56 (0xe35b bytes) 1713429670.124612 write done 000199[0] 1713429670.131637 trunc from 0x200000 to 0x1f7017 (0x8fe8 bytes) 1713429670.149559 truncate done 000200[0] 1713429670.151690 mapwrite 0x171ca9 thru 0x1739b6 (0x1d0e bytes) 1713429670.151928 mmap done 1713429670.212604 msync done 1713429670.212785 munmap done 000201[1] 1713429670.220918 trunc from 0x1f7018 to 0x139323 (0xbdcf4 bytes) 1713429670.232267 truncate done 000202[1] 1713429670.233886 write 0x089a4d thru 0x0929cb (0x8f7f bytes) 1713429670.237816 write done 000206[0] 1713429670.249699 mapread 0x11335d thru 0x11ac9c (0x7940 bytes) 1713429670.252803 mmap done 1713429670.272849 memcpy done 1713429670.272979 munmap done 000208[0] 1713429670.275470 trunc from 0x139324 to 0x11fc3e (0x196e5 bytes) 1713429670.299656 truncate done 000209[0] 1713429670.314616 trunc from 0x11fc3f to 0x033839 (0xec405 bytes) 1713429670.321711 truncate done 000210[1] 1713429670.330817 mapread 0x029ed9 thru 0x033839 (0x9961 bytes) 1713429670.333933 mmap done 1713429670.359289 memcpy done 1713429670.359403 munmap done 000211[1] 1713429670.363939 trunc from 0x03383a to 0x0a982b (0x75ff2 bytes) 1713429670.372071 truncate done 000213[0] 1713429670.374072 read 0x0a74df thru 0x0a982b (0x234d bytes) 1713429670.386815 read done 000214[1] 1713429670.396774 mapread 0x01b8db thru 0x020aea (0x5210 bytes) 1713429670.398648 mmap done 1713429670.414413 memcpy done 1713429670.414528 munmap done 000215[1] 1713429670.423031 write 0x1209c8 thru 0x12a47d (0x9ab6 bytes) 1713429670.423804 write done 000218[0] 1713429670.424615 write 0x0bf36e thru 0x0c108d (0x1d20 bytes) 1713429670.431758 write done 000220[0] 1713429670.454420 mapread 0x0a5356 thru 0x0aa043 (0x4cee bytes) 1713429670.457949 mmap done 1713429670.473530 memcpy done 1713429670.473707 munmap done 000221[1] 1713429670.481292 mapread 0x0753ad thru 0x079855 (0x44a9 bytes) 1713429670.484240 mmap done 1713429670.496634 memcpy done 1713429670.496720 munmap done 000225[1] 1713429670.507217 mapread 0x0f1b3e thru 0x0f1c4f (0x112 bytes) 1713429670.507446 mmap done 1713429670.509259 memcpy done 1713429670.509417 munmap done 000227[1] 1713429670.514996 write 0x08bce2 thru 0x0943ba (0x86d9 bytes) 1713429670.522660 write done 000228[0] 1713429670.529245 trunc from 0x12a47e to 0x15f10e (0x34c91 bytes) 1713429670.547833 truncate done 000229[0] 1713429670.557132 read 0x008b3b thru 0x0133d9 (0xa89f bytes) 1713429670.569119 read done 000230[0] 1713429670.571687 read 0x0f1137 thru 0x0f824e (0x7118 bytes) 1713429670.571818 read done 000231[0] 1713429670.579456 trunc from 0x15f10f to 0x146540 (0x18bce bytes) 1713429670.586147 truncate done 000232[0] 1713429670.588666 trunc from 0x146541 to 0x02f47e (0x1170c2 bytes) 1713429670.593996 truncate done 000233[1] 1713429670.596741 read 0x003639 thru 0x00e466 (0xae2e bytes) 1713429670.603808 read done 000234[1] 1713429670.612507 read 0x00cd22 thru 0x019e0b (0xd0ea bytes) 1713429670.612650 read done 000239[1] 1713429670.632063 trunc from 0x02f47f to 0x0eba76 (0xbc5f8 bytes) 1713429670.644954 truncate done 000240[0] 1713429670.647013 write 0x0032ee thru 0x00c743 (0x9456 bytes) 1713429670.660724 write done 000242[0] 1713429670.672357 write 0x0aa41b thru 0x0b07c9 (0x63af bytes) 1713429670.672837 write done 000243[0] 1713429670.682939 read 0x021aad thru 0x02ee77 (0xd3cb bytes) 1713429670.683087 read done 000244[1] 1713429670.689591 mapwrite 0x033b63 thru 0x0394ed (0x598b bytes) 1713429670.692890 mmap done 1713429670.735954 msync done 1713429670.736045 munmap done 000250[1] 1713429670.755958 mapread 0x0b1ac4 thru 0x0babbb (0x90f8 bytes) 1713429670.756140 mmap done 1713429670.756222 memcpy done 1713429670.756284 munmap done 000252[0] 1713429670.756682 mapwrite 0x079877 thru 0x087d0d (0xe497 bytes) 1713429670.759040 mmap done 1713429670.786661 msync done 1713429670.786802 munmap done 000256[1] 1713429670.808456 mapread 0x061c3f thru 0x06bcea (0xa0ac bytes) 1713429670.811707 mmap done 1713429670.837761 memcpy done 1713429670.837919 munmap done 000258[1] 1713429670.844895 read 0x0ea755 thru 0x0eba76 (0x1322 bytes) 1713429670.854103 read done 000260[0] 1713429670.865906 read 0x0bb76e thru 0x0c9ec4 (0xe757 bytes) 1713429670.875969 read done 000263[1] 1713429670.882088 mapread 0x0aa929 thru 0x0b5045 (0xa71d bytes) 1713429670.882258 mmap done 1713429670.882330 memcpy done 1713429670.882432 munmap done 000264[0] 1713429670.889694 mapwrite 0x15b17a thru 0x15d380 (0x2207 bytes) 1713429670.905131 truncate done 1713429670.905350 mmap done 1713429670.938324 msync done 1713429670.938576 munmap done 000266[0] 1713429670.954654 read 0x140f97 thru 0x147f42 (0x6fac bytes) 1713429670.954815 read done 000267[0] 1713429670.957359 trunc from 0x15d381 to 0x191259 (0x33ed9 bytes) 1713429670.962648 truncate done 000268[0] 1713429670.971303 mapread 0x00663d thru 0x015bb3 (0xf577 bytes) 1713429670.971588 mmap done 1713429670.982736 memcpy done 1713429670.982973 munmap done 000272[1] 1713429670.993339 read 0x1905fa thru 0x191259 (0xc60 bytes) 1713429671.002716 read done 000277[0] 1713429671.016250 mapwrite 0x0f7e69 thru 0x103cdf (0xbe77 bytes) 1713429671.016611 mmap done 1713429671.079719 msync done 1713429671.080098 munmap done 000279[0] 1713429671.087945 write 0x158817 thru 0x165965 (0xd14f bytes) 1713429671.092900 write done 000283[1] 1713429671.112596 mapread 0x13f186 thru 0x140049 (0xec4 bytes) 1713429671.115694 mmap done 1713429671.125087 memcpy done 1713429671.125200 munmap done 000285[0] 1713429671.132191 read 0x0d2e6e thru 0x0d5d58 (0x2eeb bytes) 1713429671.132534 read done 000287[1] 1713429671.142458 read 0x05f753 thru 0x06c623 (0xced1 bytes) 1713429671.157154 read done 000288[1] 1713429671.158912 read 0x03ccdc thru 0x045548 (0x886d bytes) 1713429671.159082 read done 000291[1] 1713429671.159790 mapwrite 0x1c2f5a thru 0x1c8a92 (0x5b39 bytes) 1713429671.175448 truncate done 1713429671.175745 mmap done 1713429671.226712 msync done 1713429671.226832 munmap done 000294[0] 1713429671.240693 read 0x073311 thru 0x07cce3 (0x99d3 bytes) 1713429671.252236 read done 000295[1] 1713429671.258649 mapwrite 0x1554e1 thru 0x1646ee (0xf20e bytes) 1713429671.261249 mmap done 1713429671.284891 msync done 1713429671.284994 munmap done 000299[1] 1713429671.303800 write 0x1e5933 thru 0x1e9185 (0x3853 bytes) 1713429671.304665 write done 000301[1] 1713429671.312050 trunc from 0x1e9186 to 0x1900b5 (0x590d0 bytes) 1713429671.323964 truncate done 000305[0] 1713429671.343291 read 0x186ec3 thru 0x1900b5 (0x91f3 bytes) 1713429671.368041 read done 000308[0] 1713429671.370711 mapwrite 0x1cf3a9 thru 0x1d4840 (0x5498 bytes) 1713429671.380833 truncate done 1713429671.381301 mmap done 1713429671.422632 msync done 1713429671.422788 munmap done 000309[1] 1713429671.424651 read 0x1053b5 thru 0x1085f5 (0x3241 bytes) 1713429671.440372 read done 000310[1] 1713429671.442622 mapwrite 0x04893d thru 0x04f171 (0x6835 bytes) 1713429671.446888 mmap done 1713429671.486554 msync done 1713429671.486650 munmap done 000313[1] 1713429671.501800 trunc from 0x1d4841 to 0x1f6bff (0x223bf bytes) 1713429671.512904 truncate done 000314[0] 1713429671.520364 read 0x198d73 thru 0x1a6309 (0xd597 bytes) 1713429671.552965 read done 000315[1] 1713429671.560357 trunc from 0x1f6c00 to 0x094a8f (0x162170 bytes) 1713429671.567932 truncate done 000318[0] 1713429671.587624 mapwrite 0x0ba2c2 thru 0x0bb5bc (0x12fb bytes) 1713429671.597064 truncate done 1713429671.597230 mmap done 1713429671.621008 msync done 1713429671.621077 munmap done 000320[0] 1713429671.629126 mapwrite 0x00b064 thru 0x012f50 (0x7eed bytes) 1713429671.629442 mmap done 1713429671.644062 msync done 1713429671.644127 munmap done 000322[1] 1713429671.651204 write 0x14ffe3 thru 0x15ed12 (0xed30 bytes) 1713429671.654483 write done 000325[0] 1713429671.669200 trunc from 0x15ed13 to 0x1f07f6 (0x91ae4 bytes) 1713429671.680596 truncate done 000327[0] 1713429671.689257 mapread 0x0bb3fb thru 0x0c8114 (0xcd1a bytes) 1713429671.689511 mmap done 1713429671.695637 memcpy done 1713429671.695830 munmap done 000329[0] 1713429671.702172 trunc from 0x1f07f7 to 0x0a287b (0x14df7b bytes) 1713429671.709642 truncate done 000333[1] 1713429671.721075 mapwrite 0x137ee7 thru 0x1470d7 (0xf1f1 bytes) 1713429671.736506 truncate done 1713429671.736679 mmap done 1713429671.829802 msync done 1713429671.829907 munmap done 000335[1] 1713429671.843320 write 0x13d16d thru 0x146a14 (0x98a8 bytes) 1713429671.844028 write done 000339[1] 1713429671.868946 trunc from 0x1470d8 to 0x054954 (0xf2783 bytes) 1713429671.876431 truncate done 000341[0] 1713429671.890442 mapread 0x015956 thru 0x020b02 (0xb1ad bytes) 1713429671.894907 mmap done 1713429671.926744 memcpy done 1713429671.926865 munmap done 000343[1] 1713429671.939324 mapread 0x04f2ce thru 0x0520b5 (0x2de8 bytes) 1713429671.943020 mmap done 1713429671.952044 memcpy done 1713429671.952108 munmap done 000344[1] 1713429671.954589 read 0x03c711 thru 0x049295 (0xcb85 bytes) 1713429671.959597 read done 000345[1] 1713429671.966464 mapwrite 0x05dcb5 thru 0x05ecab (0xff7 bytes) 1713429671.978870 truncate done 1713429671.979223 mmap done 1713429672.001706 msync done 1713429672.001912 munmap done 000346[0] 1713429672.010666 mapwrite 0x18b05d thru 0x18b0df (0x83 bytes) 1713429672.024819 truncate done 1713429672.025125 mmap done 1713429672.057929 msync done 1713429672.058028 munmap done 000347[1] 1713429672.067528 write 0x12f466 thru 0x1381df (0x8d7a bytes) 1713429672.074824 write done 000348[1] 1713429672.080764 mapread 0x15f056 thru 0x161a05 (0x29b0 bytes) 1713429672.085827 mmap done 1713429672.094540 memcpy done 1713429672.094605 munmap done 000349[0] 1713429672.101358 mapwrite 0x0af726 thru 0x0b6feb (0x78c6 bytes) 1713429672.103554 mmap done 1713429672.169153 msync done 1713429672.169289 munmap done 000351[0] 1713429672.180659 mapread 0x0a1663 thru 0x0addbb (0xc759 bytes) 1713429672.183521 mmap done 1713429672.209549 memcpy done 1713429672.209764 munmap done 000356[1] 1713429672.250965 mapread 0x180bbb thru 0x182c66 (0x20ac bytes) 1713429672.253703 mmap done 1713429672.259218 memcpy done 1713429672.259453 munmap done 000358[1] 1713429672.272088 write 0x18fda1 thru 0x1998ec (0x9b4c bytes) 1713429672.272885 write done 000362[0] 1713429672.294920 read 0x056c73 thru 0x058a9f (0x1e2d bytes) 1713429672.301935 read done 000363[1] 1713429672.307559 write 0x06e355 thru 0x07a302 (0xbfae bytes) 1713429672.317478 write done 000364[0] 1713429672.322581 mapwrite 0x007e6b thru 0x014475 (0xc60b bytes) 1713429672.325219 mmap done 1713429672.374644 msync done 1713429672.374714 munmap done 000367[1] 1713429672.389887 trunc from 0x1998ed to 0x062bbd (0x136d2f bytes) 1713429672.398130 truncate done 000368[1] 1713429672.403653 mapread 0x029caa thru 0x035c0d (0xbf64 bytes) 1713429672.403830 mmap done 1713429672.421841 memcpy done 1713429672.421958 munmap done 000369[0] 1713429672.423723 read 0x0533c4 thru 0x05eb46 (0xb783 bytes) 1713429672.432373 read done 000371[0] 1713429672.445909 write 0x11d270 thru 0x121782 (0x4513 bytes) 1713429672.449837 write done 000375[0] 1713429672.465977 trunc from 0x121783 to 0x0930d3 (0x8e6af bytes) 1713429672.481134 truncate done 000376[0] 1713429672.491466 mapwrite 0x00f195 thru 0x017f67 (0x8dd3 bytes) 1713429672.491904 mmap done 1713429672.539603 msync done 1713429672.539796 munmap done 000378[0] 1713429672.551559 mapwrite 0x031925 thru 0x03d45d (0xbb39 bytes) 1713429672.551925 mmap done 1713429672.586823 msync done 1713429672.586902 munmap done 000379[0] 1713429672.589142 mapread 0x0743e9 thru 0x077a58 (0x3670 bytes) 1713429672.589338 mmap done 1713429672.589490 memcpy done 1713429672.589627 munmap done 000380[0] 1713429672.595896 read 0x0835aa thru 0x08f533 (0xbf8a bytes) 1713429672.596029 read done 000383[0] 1713429672.596779 read 0x081922 thru 0x08acab (0x938a bytes) 1713429672.596868 read done 000390[0] 1713429672.606081 mapread 0x08fa47 thru 0x0930d3 (0x368d bytes) 1713429672.606210 mmap done 1713429672.606267 memcpy done 1713429672.606295 munmap done 000391[1] 1713429672.612212 read 0x0412cb thru 0x049766 (0x849c bytes) 1713429672.622836 read done 000392[0] 1713429672.629896 read 0x02f68e thru 0x037841 (0x81b4 bytes) 1713429672.637874 read done 000397[0] 1713429672.651890 trunc from 0x0930d4 to 0x0a7eb1 (0x14dde bytes) 1713429672.663884 truncate done 000398[0] 1713429672.666140 mapwrite 0x1c44d1 thru 0x1c5648 (0x1178 bytes) 1713429672.670501 truncate done 1713429672.670659 mmap done 1713429672.709037 msync done 1713429672.709119 munmap done 000399[1] 1713429672.711277 mapread 0x168dc7 thru 0x171182 (0x83bc bytes) 1713429672.713957 mmap done 1713429672.739662 memcpy done 1713429672.740087 munmap done 000402[0] 1713429672.755702 mapread 0x00f3e0 thru 0x019c9f (0xa8c0 bytes) 1713429672.755934 mmap done 1713429672.774750 memcpy done 1713429672.774888 munmap done 000403[0] 1713429672.780732 mapread 0x1b1b29 thru 0x1b5bb5 (0x408d bytes) 1713429672.780994 mmap done 1713429672.791814 memcpy done 1713429672.792227 munmap done 000405[0] 1713429672.802371 read 0x02ea5a thru 0x0388b0 (0x9e57 bytes) 1713429672.811877 read done 000406[1] 1713429672.812248 read 0x1a1e76 thru 0x1a6397 (0x4522 bytes) 1713429672.824252 read done 000407[1] 1713429672.828427 mapread 0x0e427d thru 0x0e8690 (0x4414 bytes) 1713429672.830907 mmap done 1713429672.844280 memcpy done 1713429672.844368 munmap done 000408[1] 1713429672.844723 write 0x0c7a0a thru 0x0c7d29 (0x320 bytes) 1713429672.849178 write done 000409[0] 1713429672.849497 write 0x04062f thru 0x050367 (0xfd39 bytes) 1713429672.857106 write done 000411[1] 1713429672.861733 mapwrite 0x137a1b thru 0x143001 (0xb5e7 bytes) 1713429672.864201 mmap done 1713429672.939054 msync done 1713429672.939241 munmap done 000413[1] 1713429672.949271 mapread 0x081688 thru 0x08397c (0x22f5 bytes) 1713429672.951558 mmap done 1713429672.961067 memcpy done 1713429672.961143 munmap done 000414[1] 1713429672.961399 read 0x1630fe thru 0x1730dc (0xffdf bytes) 1713429672.971345 read done 000415[0] 1713429672.975800 mapread 0x0b851c thru 0x0c1756 (0x923b bytes) 1713429672.977795 mmap done 1713429672.994011 memcpy done 1713429672.994095 munmap done 000417[0] 1713429672.994689 write 0x039340 thru 0x0404bf (0x7180 bytes) 1713429673.004447 write done 000420[0] 1713429673.021528 mapwrite 0x1fd6bf thru 0x1fffff (0x2941 bytes) 1713429673.032363 truncate done 1713429673.032560 mmap done 1713429673.073729 msync done 1713429673.073806 munmap done 000421[1] 1713429673.076162 read 0x00f827 thru 0x01dd87 (0xe561 bytes) 1713429673.089183 read done 000422[0] 1713429673.090995 mapwrite 0x1d8cba thru 0x1db2fa (0x2641 bytes) 1713429673.091201 mmap done 1713429673.108951 msync done 1713429673.109013 munmap done 000423[0] 1713429673.109344 mapread 0x15634a thru 0x15b40c (0x50c3 bytes) 1713429673.109691 mmap done 1713429673.119195 memcpy done 1713429673.119260 munmap done 000428[0] 1713429673.133003 mapwrite 0x0a6c1b thru 0x0abf69 (0x534f bytes) 1713429673.133466 mmap done 1713429673.172651 msync done 1713429673.172712 munmap done 000429[1] 1713429673.179204 write 0x1a89d1 thru 0x1b82c2 (0xf8f2 bytes) 1713429673.187097 write done 000430[1] 1713429673.192242 mapread 0x028027 thru 0x02e208 (0x61e2 bytes) 1713429673.195183 mmap done 1713429673.217476 memcpy done 1713429673.217585 munmap done 000431[0] 1713429673.225724 mapwrite 0x0d4140 thru 0x0dacd9 (0x6b9a bytes) 1713429673.227826 mmap done 1713429673.319974 msync done 1713429673.320039 munmap done 000432[1] 1713429673.327301 mapread 0x065e25 thru 0x068988 (0x2b64 bytes) 1713429673.331870 mmap done 1713429673.342640 memcpy done 1713429673.342723 munmap done 000434[1] 1713429673.354279 mapread 0x0bed1b thru 0x0c70ed (0x83d3 bytes) 1713429673.354542 mmap done 1713429673.371395 memcpy done 1713429673.371459 munmap done 000437[1] 1713429673.377643 mapread 0x1d3364 thru 0x1dbccd (0x896a bytes) 1713429673.377775 mmap done 1713429673.377838 memcpy done 1713429673.377880 munmap done 000440[1] 1713429673.389059 mapread 0x00f6a5 thru 0x010680 (0xfdc bytes) 1713429673.389273 mmap done 1713429673.394067 memcpy done 1713429673.394123 munmap done 000441[0] 1713429673.394457 write 0x0c39e9 thru 0x0cf82d (0xbe45 bytes) 1713429673.405268 write done 000446[0] 1713429673.438309 write 0x133d08 thru 0x137c2d (0x3f26 bytes) 1713429673.449327 write done 000451[0] 1713429673.456748 trunc from 0x200000 to 0x0697a2 (0x19685d bytes) 1713429673.462030 truncate done 000453[1] 1713429673.475899 write 0x1bf116 thru 0x1ca06f (0xaf5a bytes) 1713429673.480245 write done 000454[0] 1713429673.486155 mapwrite 0x1ae6f9 thru 0x1bb5bc (0xcec4 bytes) 1713429673.489146 mmap done 1713429673.563604 msync done 1713429673.563712 munmap done 000457[0] 1713429673.579261 trunc from 0x1ca070 to 0x1a41b0 (0x25ebf bytes) 1713429673.584873 truncate done 000458[0] 1713429673.593767 mapwrite 0x06183a thru 0x06888a (0x7051 bytes) 1713429673.594043 mmap done 1713429673.629021 msync done 1713429673.629196 munmap done 000460[0] 1713429673.632214 mapwrite 0x111596 thru 0x11d53f (0xbfaa bytes) 1713429673.632506 mmap done 1713429673.689303 msync done 1713429673.689433 munmap done 000464[1] 1713429673.696327 write 0x1139d9 thru 0x113f6f (0x597 bytes) 1713429673.702152 write done 000465[0] 1713429673.709902 mapwrite 0x04b89e thru 0x051d3b (0x649e bytes) 1713429673.714593 mmap done 1713429673.746030 msync done 1713429673.746129 munmap done 000466[1] 1713429673.752869 trunc from 0x1a41b1 to 0x068980 (0x13b830 bytes) 1713429673.763410 truncate done 000467[1] 1713429673.771579 write 0x0773b2 thru 0x07cdc0 (0x5a0f bytes) 1713429673.772157 write done 000468[0] 1713429673.778980 read 0x0538c8 thru 0x0588a6 (0x4fdf bytes) 1713429673.791053 read done 000470[1] 1713429673.800371 mapwrite 0x095701 thru 0x097e0d (0x270d bytes) 1713429673.811104 truncate done 1713429673.811284 mmap done 1713429673.833656 msync done 1713429673.833735 munmap done 000471[1] 1713429673.839955 mapwrite 0x130234 thru 0x13d5ee (0xd3bb bytes) 1713429673.844568 truncate done 1713429673.844786 mmap done 1713429673.899327 msync done 1713429673.899561 munmap done 000472[1] 1713429673.902165 write 0x1dcecd thru 0x1e7b87 (0xacbb bytes) 1713429673.903142 write done 000474[0] 1713429673.918419 mapwrite 0x11dfbd thru 0x127f32 (0x9f76 bytes) 1713429673.921961 mmap done 1713429673.983316 msync done 1713429673.983424 munmap done 000478[1] 1713429674.006139 mapread 0x004316 thru 0x013837 (0xf522 bytes) 1713429674.008518 mmap done 1713429674.040623 memcpy done 1713429674.040727 munmap done 000482[1] 1713429674.068662 mapread 0x1b1f5f thru 0x1b6f30 (0x4fd2 bytes) 1713429674.073272 mmap done 1713429674.092185 memcpy done 1713429674.092333 munmap done 000487[1] 1713429674.114250 mapwrite 0x15f3bb thru 0x1645c9 (0x520f bytes) 1713429674.114592 mmap done 1713429674.164335 msync done 1713429674.164549 munmap done 000488[1] 1713429674.170702 read 0x19b9c2 thru 0x1aabbe (0xf1fd bytes) 1713429674.185302 read done 000493[1] 1713429674.222680 trunc from 0x1e7b88 to 0x0157d2 (0x1d23b5 bytes) 1713429674.231429 truncate done 000496[1] 1713429674.257316 write 0x0b2946 thru 0x0b7c95 (0x5350 bytes) 1713429674.257802 write done 000498[1] 1713429674.265870 write 0x0372d0 thru 0x03b1b1 (0x3ee2 bytes) 1713429674.271177 write done 000499[0] 1713429674.271451 mapwrite 0x079d7d thru 0x07d22e (0x34b2 bytes) 1713429674.274442 mmap done 1713429674.318378 msync done 1713429674.318489 munmap done 000500[1] 1713429674.324760 write 0x09b5ac thru 0x09d1d2 (0x1c27 bytes) 1713429674.334441 write done 000501[1] 1713429674.342715 read 0x0562be thru 0x05a526 (0x4269 bytes) 1713429674.352930 read done 000503[1] 1713429674.361088 write 0x0e925e thru 0x0f4378 (0xb11b bytes) 1713429674.361861 write done 000504[1] 1713429674.362161 trunc from 0x0f4379 to 0x1b8b07 (0xc478f bytes) 1713429674.370295 truncate done 000506[0] 1713429674.373083 trunc from 0x1b8b08 to 0x0099c2 (0x1af145 bytes) 1713429674.396210 truncate done 000508[1] 1713429674.415775 trunc from 0x0099c3 to 0x1c8e04 (0x1bf442 bytes) 1713429674.427414 truncate done 000509[1] 1713429674.436933 trunc from 0x1c8e05 to 0x14a358 (0x7eaac bytes) 1713429674.442689 truncate done 000510[0] 1713429674.450891 mapread 0x109621 thru 0x1119d0 (0x83b0 bytes) 1713429674.455049 mmap done 1713429674.486309 memcpy done 1713429674.486580 munmap done 000511[1] 1713429674.489869 trunc from 0x14a359 to 0x0af151 (0x9b207 bytes) 1713429674.499905 truncate done 000512[1] 1713429674.502371 mapread 0x06f1d7 thru 0x07efe5 (0xfe0f bytes) 1713429674.502666 mmap done 1713429674.537206 memcpy done 1713429674.537325 munmap done 000513[0] 1713429674.544632 mapread 0x011952 thru 0x0159ce (0x407d bytes) 1713429674.547041 mmap done 1713429674.559907 memcpy done 1713429674.560010 munmap done 000514[0] 1713429674.565042 write 0x1db351 thru 0x1e29e6 (0x7696 bytes) 1713429674.569103 write done 000517[1] 1713429674.575942 mapwrite 0x171915 thru 0x175677 (0x3d63 bytes) 1713429674.579194 mmap done 1713429674.641683 msync done 1713429674.641961 munmap done 000518[1] 1713429674.648968 write 0x1e7b99 thru 0x1eef40 (0x73a8 bytes) 1713429674.649553 write done 000520[0] 1713429674.655767 mapwrite 0x054fb1 thru 0x0584a0 (0x34f0 bytes) 1713429674.658648 mmap done 1713429674.689902 msync done 1713429674.690057 munmap done 000521[0] 1713429674.695341 read 0x108241 thru 0x108f84 (0xd44 bytes) 1713429674.722687 read done 000524[0] 1713429674.736312 read 0x037d23 thru 0x03e320 (0x65fe bytes) 1713429674.736496 read done 000528[1] 1713429674.754711 write 0x05b0e9 thru 0x05b6bf (0x5d7 bytes) 1713429674.760496 write done 000529[0] 1713429674.760814 trunc from 0x1eef41 to 0x1b3221 (0x3bd1f bytes) 1713429674.774634 truncate done 000530[1] 1713429674.776334 trunc from 0x1b3222 to 0x0a2419 (0x110e08 bytes) 1713429674.787747 truncate done 000531[1] 1713429674.790145 write 0x1ae38f thru 0x1b3f4a (0x5bbc bytes) 1713429674.790796 write done 000532[0] 1713429674.799129 read 0x038b04 thru 0x04084c (0x7d49 bytes) 1713429674.808748 read done 000533[1] 1713429674.814796 mapread 0x0d9d14 thru 0x0e241a (0x8707 bytes) 1713429674.816272 mmap done 1713429674.831160 memcpy done 1713429674.831281 munmap done 000534[1] 1713429674.831708 read 0x0d425d thru 0x0e3a8f (0xf833 bytes) 1713429674.840278 read done 000537[0] 1713429674.846488 trunc from 0x1b3f4b to 0x08df63 (0x125fe7 bytes) 1713429674.862620 truncate done 000541[1] 1713429674.894711 write 0x14560e thru 0x15015e (0xab51 bytes) 1713429674.898294 write done 000544[1] 1713429674.919126 write 0x09acd6 thru 0x0a5d70 (0xb09b bytes) 1713429674.926231 write done 000545[1] 1713429674.931735 write 0x111fe3 thru 0x11484b (0x2869 bytes) 1713429674.935216 write done 000547[1] 1713429674.935784 read 0x10b99f thru 0x111dee (0x6450 bytes) 1713429674.941884 read done 000548[0] 1713429674.946521 mapwrite 0x1ac4b7 thru 0x1ba786 (0xe2d0 bytes) 1713429674.961339 truncate done 1713429674.961523 mmap done 1713429675.010771 msync done 1713429675.010920 munmap done 000552[1] 1713429675.020940 read 0x111bf5 thru 0x120068 (0xe474 bytes) 1713429675.054675 read done 000553[1] 1713429675.056917 mapwrite 0x02d825 thru 0x03c367 (0xeb43 bytes) 1713429675.061222 mmap done 1713429675.106568 msync done 1713429675.106659 munmap done 000558[0] 1713429675.143614 trunc from 0x1ba787 to 0x0db482 (0xdf304 bytes) 1713429675.159106 truncate done 000561[1] 1713429675.169845 read 0x016299 thru 0x0222c6 (0xc02e bytes) 1713429675.180469 read done 000562[0] 1713429675.182720 write 0x1d2d0c thru 0x1dedd7 (0xc0cc bytes) 1713429675.183779 write done 000563[1] 1713429675.189358 write 0x1fc54b thru 0x1fffff (0x3ab5 bytes) 1713429675.195939 write done 000564[1] 1713429675.196258 mapwrite 0x08275d thru 0x08a3d9 (0x7c7d bytes) 1713429675.197220 mmap done 1713429675.251461 msync done 1713429675.251544 munmap done 000565[1] 1713429675.251918 read 0x096742 thru 0x09af4c (0x480b bytes) 1713429675.259409 read done 000568[1] 1713429675.264665 read 0x1a1392 thru 0x1ab56a (0xa1d9 bytes) 1713429675.264795 read done 000569[0] 1713429675.269499 mapwrite 0x165238 thru 0x173317 (0xe0e0 bytes) 1713429675.271952 mmap done 1713429675.345212 msync done 1713429675.345449 munmap done 000573[1] 1713429675.373192 mapread 0x0abf4f thru 0x0ad488 (0x153a bytes) 1713429675.376028 mmap done 1713429675.376114 memcpy done 1713429675.376145 munmap done 000574[1] 1713429675.382179 read 0x190aaf thru 0x19c803 (0xbd55 bytes) 1713429675.397936 read done 000580[1] 1713429675.410808 read 0x171d57 thru 0x17f3b4 (0xd65e bytes) 1713429675.411001 read done 000581[0] 1713429675.411285 write 0x152063 thru 0x161119 (0xf0b7 bytes) 1713429675.421130 write done 000585[0] 1713429675.442451 read 0x1e319d thru 0x1e4594 (0x13f8 bytes) 1713429675.446355 read done 000586[1] 1713429675.451895 mapread 0x056733 thru 0x05e1a3 (0x7a71 bytes) 1713429675.455358 mmap done 1713429675.455548 memcpy done 1713429675.455600 munmap done 000587[0] 1713429675.460909 mapwrite 0x060b3f thru 0x06949d (0x895f bytes) 1713429675.463301 mmap done 1713429675.502640 msync done 1713429675.503110 munmap done 000588[0] 1713429675.509433 mapwrite 0x10dda1 thru 0x118a47 (0xaca7 bytes) 1713429675.509738 mmap done 1713429675.557925 msync done 1713429675.558020 munmap done 000589[1] 1713429675.568586 write 0x1550a8 thru 0x15f154 (0xa0ad bytes) 1713429675.580260 write done 000594[1] 1713429675.613461 trunc from 0x200000 to 0x02ae73 (0x1d518c bytes) 1713429675.622983 truncate done 000596[0] 1713429675.632787 mapwrite 0x03f7d4 thru 0x04822e (0x8a5b bytes) 1713429675.646340 truncate done 1713429675.646681 mmap done 1713429675.698803 msync done 1713429675.698975 munmap done 000598[1] 1713429675.708644 read 0x01b434 thru 0x01fad9 (0x46a6 bytes) 1713429675.718217 read done 000600[0] 1713429675.733686 trunc from 0x04822f to 0x15cb0a (0x1148dc bytes) 1713429675.742937 truncate done 000602[0] 1713429675.745004 read 0x10daa6 thru 0x119563 (0xbabe bytes) 1713429675.752476 read done 000604[0] 1713429675.759797 read 0x003283 thru 0x00a8a7 (0x7625 bytes) 1713429675.759928 read done 000606[0] 1713429675.760440 mapread 0x001b53 thru 0x00676a (0x4c18 bytes) 1713429675.760724 mmap done 1713429675.760816 memcpy done 1713429675.761039 munmap done 000609[0] 1713429675.777177 mapread 0x0319c8 thru 0x034fc0 (0x35f9 bytes) 1713429675.777418 mmap done 1713429675.777481 memcpy done 1713429675.777534 munmap done 000610[0] 1713429675.777883 trunc from 0x15cb0b to 0x1e591a (0x88e10 bytes) 1713429675.784837 truncate done 000615[0] 1713429675.813027 write 0x0cae44 thru 0x0da7e2 (0xf99f bytes) 1713429675.813690 write done 000616[0] 1713429675.819335 write 0x12f6d1 thru 0x137dcd (0x86fd bytes) 1713429675.819786 write done 000617[1] 1713429675.825997 trunc from 0x1e591b to 0x1fe96c (0x19052 bytes) 1713429675.849559 truncate done 000620[0] 1713429675.861470 mapwrite 0x0401e7 thru 0x04eb43 (0xe95d bytes) 1713429675.865167 mmap done 1713429675.901845 msync done 1713429675.901943 munmap done 000623[1] 1713429675.923556 write 0x16b619 thru 0x16d09b (0x1a83 bytes) 1713429675.928631 write done 000624[1] 1713429675.937200 mapread 0x14ddab thru 0x15c7cd (0xea23 bytes) 1713429675.941402 mmap done 1713429675.975330 memcpy done 1713429675.975421 munmap done 000625[1] 1713429675.981197 read 0x0272d5 thru 0x030d14 (0x9a40 bytes) 1713429675.995167 read done 000626[1] 1713429675.995494 read 0x1df502 thru 0x1e4c48 (0x5747 bytes) 1713429675.996582 read done 000629[0] 1713429676.007736 mapwrite 0x0a171e thru 0x0ab6b1 (0x9f94 bytes) 1713429676.010211 mmap done 1713429676.059360 msync done 1713429676.059479 munmap done 000632[1] 1713429676.080995 read 0x170535 thru 0x170617 (0xe3 bytes) 1713429676.081110 read done 000636[0] 1713429676.108880 trunc from 0x1fe96d to 0x1f244c (0xc520 bytes) 1713429676.122233 truncate done 000639[1] 1713429676.144959 trunc from 0x1f244d to 0x043849 (0x1aec03 bytes) 1713429676.154647 truncate done 000641[0] 1713429676.166201 mapwrite 0x09aefd thru 0x0a2fb4 (0x80b8 bytes) 1713429676.180127 truncate done 1713429676.180327 mmap done 1713429676.227567 msync done 1713429676.228570 munmap done 000645[1] 1713429676.247685 write 0x1fd9dd thru 0x1fffff (0x2623 bytes) 1713429676.251474 write done 000646[0] 1713429676.256979 trunc from 0x200000 to 0x1d1717 (0x2e8e8 bytes) 1713429676.268452 truncate done 000648[1] 1713429676.276693 mapwrite 0x003587 thru 0x00d806 (0xa280 bytes) 1713429676.279332 mmap done 1713429676.309172 msync done 1713429676.309273 munmap done 000649[0] 1713429676.315619 write 0x19f7d3 thru 0x1a1ed7 (0x2705 bytes) 1713429676.319438 write done 000650[1] 1713429676.324684 write 0x1efd61 thru 0x1f1060 (0x1300 bytes) 1713429676.331249 write done 000652[0] 1713429676.337450 trunc from 0x1f1061 to 0x001a79 (0x1ef5e7 bytes) 1713429676.351345 truncate done 000653[1] 1713429676.353246 mapwrite 0x051e95 thru 0x0552da (0x3446 bytes) 1713429676.363599 truncate done 1713429676.363771 mmap done 1713429676.390138 msync done 1713429676.390313 munmap done 000654[1] 1713429676.392125 trunc from 0x0552db to 0x1df4b1 (0x18a1d7 bytes) 1713429676.397549 truncate done 000655[0] 1713429676.399142 mapwrite 0x029ed8 thru 0x02f380 (0x54a9 bytes) 1713429676.401979 mmap done 1713429676.433664 msync done 1713429676.433920 munmap done 000656[1] 1713429676.442055 write 0x03e4da thru 0x04019b (0x1cc2 bytes) 1713429676.455649 write done 000659[0] 1713429676.470642 trunc from 0x1df4b2 to 0x198418 (0x47099 bytes) 1713429676.488126 truncate done 000661[0] 1713429676.490065 write 0x185709 thru 0x18e8c5 (0x91bd bytes) 1713429676.499803 write done 000663 1713429676.516315 [0]close/open 1713429676.517794 close done 1713429676.522364 open done 000665[1] 1713429676.532564 write 0x143648 thru 0x147af6 (0x44af bytes) 1713429676.542420 write done 000666[1] 1713429676.546980 read 0x1189ef thru 0x11aeeb (0x24fd bytes) 1713429676.550874 read done 000668[1] 1713429676.559585 trunc from 0x198419 to 0x1979e7 (0xa31 bytes) 1713429676.566702 truncate done 000669[1] 1713429676.568255 write 0x043aa4 thru 0x0458da (0x1e37 bytes) 1713429676.576277 write done 000672[1] 1713429676.599731 trunc from 0x1979e8 to 0x1683e8 (0x2f5ff bytes) 1713429676.606789 truncate done 000673[0] 1713429676.608962 write 0x0b8fa2 thru 0x0bcaed (0x3b4c bytes) 1713429676.615229 write done 000678[1] 1713429676.644540 mapread 0x0a7712 thru 0x0aafd9 (0x38c8 bytes) 1713429676.646513 mmap done 1713429676.657654 memcpy done 1713429676.657744 munmap done 000679[1] 1713429676.663363 write 0x10feda thru 0x1161f8 (0x631f bytes) 1713429676.664224 write done 000680[1] 1713429676.668950 trunc from 0x1683e9 to 0x080aaa (0xe793e bytes) 1713429676.678053 truncate done 000681[1] 1713429676.680159 mapread 0x030584 thru 0x039fea (0x9a67 bytes) 1713429676.680327 mmap done 1713429676.696891 memcpy done 1713429676.696992 munmap done 000687[1] 1713429676.707134 mapread 0x07d135 thru 0x080aaa (0x3976 bytes) 1713429676.707312 mmap done 1713429676.715012 memcpy done 1713429676.715108 munmap done 000688[0] 1713429676.723787 trunc from 0x080aab to 0x0e9261 (0x687b7 bytes) 1713429676.740362 truncate done 000689[1] 1713429676.752800 mapread 0x085e6e thru 0x090566 (0xa6f9 bytes) 1713429676.756865 mmap done 1713429676.785460 memcpy done 1713429676.785585 munmap done 000691[0] 1713429676.799997 read 0x0cc6bf thru 0x0d05c4 (0x3f06 bytes) 1713429676.805088 read done 000692[1] 1713429676.807268 mapread 0x0b0788 thru 0x0ba707 (0x9f80 bytes) 1713429676.816175 mmap done 1713429676.844225 memcpy done 1713429676.844598 munmap done 000693[1] 1713429676.844996 mapwrite 0x1719e1 thru 0x173fe4 (0x2604 bytes) 1713429676.866823 truncate done 1713429676.867598 mmap done 1713429676.925566 msync done 1713429676.925673 munmap done 000696[1] 1713429676.947809 mapwrite 0x04257d thru 0x044f14 (0x2998 bytes) 1713429676.948064 mmap done 1713429676.974224 msync done 1713429676.974300 munmap done 000697[0] 1713429676.980988 write 0x1167cd thru 0x11c799 (0x5fcd bytes) 1713429676.987343 write done 000698[0] 1713429676.995672 read 0x12268c thru 0x129900 (0x7275 bytes) 1713429677.015486 read done 000700[1] 1713429677.032599 write 0x1c2f09 thru 0x1cc261 (0x9359 bytes) 1713429677.044505 write done 000702[1] 1713429677.052463 trunc from 0x1cc262 to 0x0ad56a (0x11ecf7 bytes) 1713429677.061660 truncate done 000704[0] 1713429677.075952 trunc from 0x0ad56b to 0x08b01a (0x22550 bytes) 1713429677.087446 truncate done 000707[1] 1713429677.098517 trunc from 0x08b01b to 0x170be8 (0xe5bce bytes) 1713429677.110947 truncate done 000708[0] 1713429677.119708 read 0x1414be thru 0x14e12a (0xcc6d bytes) 1713429677.157712 read done 000711 1713429677.170821 [0]close/open 1713429677.172453 close done 1713429677.176845 open done 000712[1] 1713429677.182028 trunc from 0x170be9 to 0x02c883 (0x144365 bytes) 1713429677.191216 truncate done 000716[1] 1713429677.221296 mapread 0x010b0e thru 0x01fcbc (0xf1af bytes) 1713429677.221612 mmap done 1713429677.250967 memcpy done 1713429677.251079 munmap done 000717[1] 1713429677.258104 trunc from 0x02c884 to 0x0e3a13 (0xb7190 bytes) 1713429677.264098 truncate done 000719[1] 1713429677.266163 mapwrite 0x1c0ad4 thru 0x1cc731 (0xbc5e bytes) 1713429677.269755 truncate done 1713429677.270102 mmap done 1713429677.325913 msync done 1713429677.326243 munmap done 000721[1] 1713429677.338089 trunc from 0x1cc732 to 0x180a17 (0x4bd1a bytes) 1713429677.345245 truncate done 000722[0] 1713429677.355965 write 0x171a82 thru 0x17ce19 (0xb398 bytes) 1713429677.365566 write done 000723[0] 1713429677.375861 mapwrite 0x1c6278 thru 0x1d4330 (0xe0b9 bytes) 1713429677.383567 truncate done 1713429677.383771 mmap done 1713429677.423106 msync done 1713429677.423272 munmap done 000727[1] 1713429677.437462 write 0x0ec898 thru 0x0f6797 (0x9f00 bytes) 1713429677.440736 write done 000728[1] 1713429677.445857 read 0x0a2514 thru 0x0ab793 (0x9280 bytes) 1713429677.453762 read done 000730[0] 1713429677.464865 mapwrite 0x1884a3 thru 0x193519 (0xb077 bytes) 1713429677.468426 mmap done 1713429677.499160 msync done 1713429677.499243 munmap done 000731[0] 1713429677.504209 mapread 0x10ca94 thru 0x117d31 (0xb29e bytes) 1713429677.506759 mmap done 1713429677.512282 memcpy done 1713429677.512447 munmap done 000732[1] 1713429677.517828 mapwrite 0x182ec4 thru 0x18ba09 (0x8b46 bytes) 1713429677.520255 mmap done 1713429677.560282 msync done 1713429677.560366 munmap done 000735[1] 1713429677.576254 mapwrite 0x04802c thru 0x05485f (0xc834 bytes) 1713429677.576804 mmap done 1713429677.601059 msync done 1713429677.601119 munmap done 000736[0] 1713429677.601486 mapwrite 0x1e96b2 thru 0x1f40a0 (0xa9ef bytes) 1713429677.616562 truncate done 1713429677.616727 mmap done 1713429677.649632 msync done 1713429677.649805 munmap done 000738[0] 1713429677.652935 write 0x1adf3e thru 0x1b348c (0x554f bytes) 1713429677.656553 write done 000739[1] 1713429677.656916 mapwrite 0x085f40 thru 0x08c1bb (0x627c bytes) 1713429677.659618 mmap done 1713429677.693919 msync done 1713429677.693998 munmap done 000741[0] 1713429677.705353 read 0x0fb9ae thru 0x100507 (0x4b5a bytes) 1713429677.713707 read done 000745[1] 1713429677.732555 mapwrite 0x0e6878 thru 0x0f505f (0xe7e8 bytes) 1713429677.736308 mmap done 1713429677.785214 msync done 1713429677.785271 munmap done 000746[0] 1713429677.790024 trunc from 0x1f40a1 to 0x151832 (0xa286e bytes) 1713429677.798514 truncate done 000748[1] 1713429677.809698 mapwrite 0x1f987e thru 0x1f9e21 (0x5a4 bytes) 1713429677.825220 truncate done 1713429677.825584 mmap done 1713429677.862466 msync done 1713429677.862796 munmap done 000749[1] 1713429677.867010 mapwrite 0x1a4458 thru 0x1b0326 (0xbecf bytes) 1713429677.868603 mmap done 1713429677.924295 msync done 1713429677.924469 munmap done 000751[0] 1713429677.935449 mapwrite 0x0ae43f thru 0x0bc187 (0xdd49 bytes) 1713429677.939017 mmap done 1713429677.976701 msync done 1713429677.976840 munmap done 000755[0] 1713429678.002239 mapread 0x10b269 thru 0x116969 (0xb701 bytes) 1713429678.005375 mmap done 1713429678.016146 memcpy done 1713429678.016328 munmap done 000757[0] 1713429678.028578 read 0x0761e2 thru 0x086171 (0xff90 bytes) 1713429678.028874 read done 000758[1] 1713429678.033689 read 0x06faa9 thru 0x0770cc (0x7624 bytes) 1713429678.047298 read done 000759[1] 1713429678.047762 read 0x0f61cb thru 0x10566a (0xf4a0 bytes) 1713429678.049893 read done 000760[0] 1713429678.051907 trunc from 0x1f9e22 to 0x0c2df0 (0x137031 bytes) 1713429678.065437 truncate done 000761[0] 1713429678.072637 trunc from 0x0c2df1 to 0x185687 (0xc2897 bytes) 1713429678.077524 truncate done 000768[1] 1713429678.110624 mapwrite 0x02701f thru 0x02ce36 (0x5e18 bytes) 1713429678.114482 mmap done 1713429678.147873 msync done 1713429678.147953 munmap done 000771[1] 1713429678.166370 mapread 0x0cfefa thru 0x0d4ab6 (0x4bbd bytes) 1713429678.168835 mmap done 1713429678.197178 memcpy done 1713429678.197246 munmap done 000772[1] 1713429678.203195 write 0x073a0a thru 0x078dec (0x53e3 bytes) 1713429678.204354 write done 000773[1] 1713429678.209658 trunc from 0x185688 to 0x1b2948 (0x2d2c1 bytes) 1713429678.220514 truncate done 000774[0] 1713429678.228123 trunc from 0x1b2949 to 0x18ed91 (0x23bb7 bytes) 1713429678.244252 truncate done 000775[1] 1713429678.253168 mapwrite 0x0655f7 thru 0x065c7a (0x684 bytes) 1713429678.256228 mmap done 1713429678.278548 msync done 1713429678.278626 munmap done 000777[0] 1713429678.290282 mapwrite 0x08d2b9 thru 0x096491 (0x91d9 bytes) 1713429678.292643 mmap done 1713429678.327421 msync done 1713429678.327517 munmap done 000781[1] 1713429678.338444 read 0x0ed153 thru 0x0f08b8 (0x3766 bytes) 1713429678.361542 read done 000783[1] 1713429678.363864 write 0x077b32 thru 0x0812fa (0x97c9 bytes) 1713429678.370584 write done 000784[0] 1713429678.375226 read 0x01e72c thru 0x024539 (0x5e0e bytes) 1713429678.389880 read done 000785[1] 1713429678.390199 read 0x080fdf thru 0x08c5ca (0xb5ec bytes) 1713429678.399129 read done 000786[1] 1713429678.399493 write 0x00acf1 thru 0x019858 (0xeb68 bytes) 1713429678.408432 write done 000787[1] 1713429678.415665 write 0x0f23c0 thru 0x0f4e71 (0x2ab2 bytes) 1713429678.416112 write done 000788[1] 1713429678.422928 trunc from 0x18ed92 to 0x128af8 (0x66299 bytes) 1713429678.431686 truncate done 000789[0] 1713429678.437815 mapwrite 0x1bf4ad thru 0x1c3646 (0x419a bytes) 1713429678.449214 truncate done 1713429678.449428 mmap done 1713429678.491156 msync done 1713429678.491265 munmap done 000792[1] 1713429678.501739 read 0x079470 thru 0x07dfc7 (0x4b58 bytes) 1713429678.511780 read done 000794[0] 1713429678.517979 trunc from 0x1c3647 to 0x147882 (0x7bdc4 bytes) 1713429678.526928 truncate done 000797[1] 1713429678.547404 read 0x0cb8be thru 0x0d0023 (0x4766 bytes) 1713429678.559162 read done 000798[1] 1713429678.560959 read 0x098bab thru 0x0a3f03 (0xb359 bytes) 1713429678.561070 read done 000799[0] 1713429678.561316 mapread 0x02a390 thru 0x02f6a7 (0x5318 bytes) 1713429678.561474 mmap done 1713429678.569716 memcpy done 1713429678.569785 munmap done 000801[1] 1713429678.570345 write 0x0300ed thru 0x033b2a (0x3a3e bytes) 1713429678.582317 write done 000805[1] 1713429678.600769 mapwrite 0x1d48d8 thru 0x1dd635 (0x8d5e bytes) 1713429678.608048 truncate done 1713429678.608224 mmap done 1713429678.641103 msync done 1713429678.641168 munmap done 000806[1] 1713429678.643332 write 0x11aa48 thru 0x126446 (0xb9ff bytes) 1713429678.643899 write done 000810[0] 1713429678.656693 trunc from 0x1dd636 to 0x03e1f0 (0x19f445 bytes) 1713429678.677000 truncate done 000815[0] 1713429678.689710 read 0x0134b8 thru 0x021a7b (0xe5c4 bytes) 1713429678.694308 read done 000816[1] 1713429678.699301 trunc from 0x03e1f1 to 0x189ca2 (0x14bab2 bytes) 1713429678.709706 truncate done 000818[0] 1713429678.717866 trunc from 0x189ca3 to 0x081848 (0x10845a bytes) 1713429678.728940 truncate done 000820[1] 1713429678.736615 trunc from 0x081849 to 0x1bf1f9 (0x13d9b1 bytes) 1713429678.746239 truncate done 000821[1] 1713429678.747946 mapread 0x14d2ab thru 0x159fc8 (0xcd1e bytes) 1713429678.748114 mmap done 1713429678.767488 memcpy done 1713429678.767588 munmap done 000823[1] 1713429678.768068 write 0x125ab3 thru 0x12ec96 (0x91e4 bytes) 1713429678.771263 write done 000824[0] 1713429678.777043 read 0x000a97 thru 0x00198a (0xef4 bytes) 1713429678.785270 read done 000829[0] 1713429678.796520 write 0x10a346 thru 0x110a17 (0x66d2 bytes) 1713429678.809356 write done 000834[0] 1713429678.820735 trunc from 0x1bf1fa to 0x0db35f (0xe3e9a bytes) 1713429678.829724 truncate done 000836[0] 1713429678.840186 trunc from 0x0db360 to 0x118d2b (0x3d9cc bytes) 1713429678.845209 truncate done 000838[1] 1713429678.855713 mapread 0x0424d0 thru 0x04b6f1 (0x9222 bytes) 1713429678.857791 mmap done 1713429678.872606 memcpy done 1713429678.872696 munmap done 000839[0] 1713429678.877089 write 0x1ff17a thru 0x1fffff (0xe86 bytes) 1713429678.877579 write done 000844[0] 1713429678.892089 read 0x176d7f thru 0x186c29 (0xfeab bytes) 1713429678.901113 read done 000848[1] 1713429678.919628 mapwrite 0x03cafe thru 0x04baa0 (0xefa3 bytes) 1713429678.922431 mmap done 1713429678.967638 msync done 1713429678.967736 munmap done 000849[1] 1713429678.972276 mapwrite 0x104520 thru 0x10bb51 (0x7632 bytes) 1713429678.974505 mmap done 1713429679.010265 msync done 1713429679.010337 munmap done 000850[1] 1713429679.015661 write 0x151d60 thru 0x159483 (0x7724 bytes) 1713429679.018597 write done 000851[0] 1713429679.018924 trunc from 0x200000 to 0x0df042 (0x120fbd bytes) 1713429679.031134 truncate done 000853[1] 1713429679.038409 mapread 0x0d36b9 thru 0x0df042 (0xb98a bytes) 1713429679.040855 mmap done 1713429679.063554 memcpy done 1713429679.063707 munmap done 000856[0] 1713429679.073867 write 0x0b4d8b thru 0x0c39bd (0xec33 bytes) 1713429679.080134 write done 000857[0] 1713429679.080474 read 0x0ac505 thru 0x0af944 (0x3440 bytes) 1713429679.086944 read done 000858[1] 1713429679.091619 read 0x06b3bd thru 0x077cb1 (0xc8f5 bytes) 1713429679.104255 read done 000859[0] 1713429679.105944 write 0x18cbb2 thru 0x1936e2 (0x6b31 bytes) 1713429679.106571 write done 000861[0] 1713429679.110930 mapread 0x092ff0 thru 0x0989f4 (0x5a05 bytes) 1713429679.111111 mmap done 1713429679.121546 memcpy done 1713429679.121590 munmap done 000863[0] 1713429679.131891 mapread 0x1859f2 thru 0x191365 (0xb974 bytes) 1713429679.132173 mmap done 1713429679.132257 memcpy done 1713429679.132303 munmap done 000865[1] 1713429679.137378 mapwrite 0x0b2806 thru 0x0b5c34 (0x342f bytes) 1713429679.139984 mmap done 1713429679.174430 msync done 1713429679.174491 munmap done 000867[0] 1713429679.184939 mapwrite 0x080734 thru 0x084396 (0x3c63 bytes) 1713429679.188370 mmap done 1713429679.212205 msync done 1713429679.212298 munmap done 000868[0] 1713429679.212653 write 0x137934 thru 0x137c89 (0x356 bytes) 1713429679.212934 write done 000869[1] 1713429679.217572 mapwrite 0x164e38 thru 0x1704a4 (0xb66d bytes) 1713429679.221301 mmap done 1713429679.268238 msync done 1713429679.268310 munmap done 000870[1] 1713429679.273419 mapwrite 0x0751ca thru 0x07a9be (0x57f5 bytes) 1713429679.275664 mmap done 1713429679.302632 msync done 1713429679.302692 munmap done 000871[1] 1713429679.303041 mapread 0x15c409 thru 0x162c55 (0x684d bytes) 1713429679.303181 mmap done 1713429679.303244 memcpy done 1713429679.303257 munmap done 000872[1] 1713429679.303496 mapread 0x17ed04 thru 0x1850e3 (0x63e0 bytes) 1713429679.303626 mmap done 1713429679.303668 memcpy done 1713429679.303719 munmap done 000876[1] 1713429679.309059 read 0x10cd24 thru 0x10ce59 (0x136 bytes) 1713429679.309152 read done 000879[1] 1713429679.314099 mapwrite 0x1192e6 thru 0x11d530 (0x424b bytes) 1713429679.314308 mmap done 1713429679.332651 msync done 1713429679.332710 munmap done 000880[1] 1713429679.333035 mapread 0x09f218 thru 0x0a0bcd (0x19b6 bytes) 1713429679.333191 mmap done 1713429679.340866 memcpy done 1713429679.340919 munmap done 000883[0] 1713429679.346151 read 0x142962 thru 0x145313 (0x29b2 bytes) 1713429679.357051 read done 000884[0] 1713429679.358538 trunc from 0x1936e3 to 0x1cbc7d (0x3859b bytes) 1713429679.369778 truncate done 000888[0] 1713429679.384930 read 0x0e15b7 thru 0x0ec3e0 (0xae2a bytes) 1713429679.395331 read done 000890[1] 1713429679.402965 trunc from 0x1cbc7e to 0x188838 (0x43445 bytes) 1713429679.418523 truncate done 000891[0] 1713429679.420461 write 0x159fdd thru 0x162c6a (0x8c8e bytes) 1713429679.428575 write done 000892[0] 1713429679.436937 write 0x049fd4 thru 0x04ece9 (0x4d16 bytes) 1713429679.444465 write done 000893[1] 1713429679.449923 read 0x0a569b thru 0x0a99af (0x4315 bytes) 1713429679.464321 read done 000895[0] 1713429679.470860 write 0x1f76bb thru 0x1f76cb (0x11 bytes) 1713429679.471267 write done 000896[1] 1713429679.478098 mapread 0x17eef6 thru 0x18e313 (0xf41e bytes) 1713429679.481082 mmap done 1713429679.499155 memcpy done 1713429679.499284 munmap done 000897[0] 1713429679.499812 read 0x14b0f1 thru 0x153f1e (0x8e2e bytes) 1713429679.514929 read done 000899[0] 1713429679.515630 trunc from 0x1f76cc to 0x10e78a (0xe8f41 bytes) 1713429679.536556 truncate done 000901[1] 1713429679.552275 write 0x0b0d40 thru 0x0bb49f (0xa760 bytes) 1713429679.559819 write done 000902[0] 1713429679.566617 read 0x098025 thru 0x09c055 (0x4031 bytes) 1713429679.582148 read done 000903[1] 1713429679.582565 trunc from 0x10e78b to 0x1d53fd (0xc6c73 bytes) 1713429679.595628 truncate done 000905[0] 1713429679.608077 mapread 0x13516c thru 0x143590 (0xe425 bytes) 1713429679.613156 mmap done 1713429679.625176 memcpy done 1713429679.625321 munmap done 000907[0] 1713429679.635751 trunc from 0x1d53fe to 0x161257 (0x741a6 bytes) 1713429679.655357 truncate done 000909[0] 1713429679.665627 write 0x04daff thru 0x05c4f6 (0xe9f8 bytes) 1713429679.670019 write done 000910[1] 1713429679.675930 read 0x1513a1 thru 0x152758 (0x13b8 bytes) 1713429679.686073 read done 000912[0] 1713429679.688243 mapwrite 0x027417 thru 0x034e9f (0xda89 bytes) 1713429679.688539 mmap done 1713429679.736538 msync done 1713429679.736729 munmap done 000915[1] 1713429679.737651 write 0x00bc17 thru 0x012118 (0x6502 bytes) 1713429679.753565 write done 000918[1] 1713429679.760065 write 0x184403 thru 0x184807 (0x405 bytes) 1713429679.764253 write done 000921[1] 1713429679.771940 mapwrite 0x1b1840 thru 0x1b7fee (0x67af bytes) 1713429679.778948 truncate done 1713429679.779136 mmap done 1713429679.814051 msync done 1713429679.815510 munmap done 000922[1] 1713429679.822450 read 0x043447 thru 0x04cae9 (0x96a3 bytes) 1713429679.822590 read done 000923[0] 1713429679.822877 mapread 0x19229f thru 0x192ea6 (0xc08 bytes) 1713429679.827711 mmap done 1713429679.834590 memcpy done 1713429679.834773 munmap done 000924[0] 1713429679.845153 read 0x01033b thru 0x010a3e (0x704 bytes) 1713429679.863647 read done 000927[1] 1713429679.866189 read 0x0d8621 thru 0x0e6161 (0xdb41 bytes) 1713429679.880373 read done 000928[0] 1713429679.880833 write 0x140e37 thru 0x14da9a (0xcc64 bytes) 1713429679.888893 write done 000931[0] 1713429679.904697 trunc from 0x1b7fef to 0x1312f2 (0x86cfc bytes) 1713429679.915887 truncate done 000932[1] 1713429679.924009 mapwrite 0x06da2c thru 0x07b7cf (0xdda4 bytes) 1713429679.926892 mmap done 1713429679.980934 msync done 1713429679.981027 munmap done 000935[1] 1713429679.998265 read 0x02a69b thru 0x02ef7f (0x48e5 bytes) 1713429680.006520 read done 000936[1] 1713429680.015317 mapread 0x01ede8 thru 0x029eb3 (0xb0cc bytes) 1713429680.018684 mmap done 1713429680.018814 memcpy done 1713429680.018892 munmap done 000940[0] 1713429680.049964 mapwrite 0x0030d7 thru 0x00c094 (0x8fbe bytes) 1713429680.053534 mmap done 1713429680.106709 msync done 1713429680.106830 munmap done 000943[0] 1713429680.107941 write 0x0f5394 thru 0x0ff3f8 (0xa065 bytes) 1713429680.112360 write done 000945[1] 1713429680.118658 mapread 0x10bed4 thru 0x110bb2 (0x4cdf bytes) 1713429680.122115 mmap done 1713429680.138256 memcpy done 1713429680.138347 munmap done 000946[1] 1713429680.145992 trunc from 0x1312f3 to 0x0f1cd7 (0x3f61b bytes) 1713429680.166063 truncate done 000947[1] 1713429680.176425 mapwrite 0x0739c5 thru 0x08295a (0xef96 bytes) 1713429680.176820 mmap done 1713429680.232251 msync done 1713429680.232440 munmap done 000949[0] 1713429680.240335 trunc from 0x0f1cd8 to 0x1d671c (0xe4a45 bytes) 1713429680.252564 truncate done 000952[0] 1713429680.269861 write 0x1f1af9 thru 0x1f61b5 (0x46bd bytes) 1713429680.270452 write done 000954[0] 1713429680.277042 write 0x08c63a thru 0x095a7a (0x9441 bytes) 1713429680.282532 write done 000960[1] 1713429680.291487 mapwrite 0x1a6595 thru 0x1a8cb4 (0x2720 bytes) 1713429680.296918 mmap done 1713429680.340897 msync done 1713429680.340957 munmap done 000961[0] 1713429680.347948 trunc from 0x1f61b6 to 0x1c30a6 (0x3310f bytes) 1713429680.357131 truncate done 000962[0] 1713429680.359175 mapread 0x163789 thru 0x1709e9 (0xd261 bytes) 1713429680.359673 mmap done 1713429680.386593 memcpy done 1713429680.387023 munmap done 000965[1] 1713429680.387868 mapwrite 0x00eba3 thru 0x013a20 (0x4e7e bytes) 1713429680.391840 mmap done 1713429680.438119 msync done 1713429680.438203 munmap done 000966[1] 1713429680.449492 mapwrite 0x066a60 thru 0x070736 (0x9cd7 bytes) 1713429680.453307 mmap done 1713429680.513321 msync done 1713429680.513413 munmap done 000968[1] 1713429680.528737 mapread 0x0bbb12 thru 0x0bd84a (0x1d39 bytes) 1713429680.532234 mmap done 1713429680.537346 memcpy done 1713429680.537615 munmap done 000970[1] 1713429680.553077 mapwrite 0x192785 thru 0x1927d3 (0x4f bytes) 1713429680.557104 mmap done 1713429680.599992 msync done 1713429680.600050 munmap done 000972[0] 1713429680.605781 mapwrite 0x1c78bf thru 0x1d6020 (0xe762 bytes) 1713429680.618813 truncate done 1713429680.618997 mmap done 1713429680.683975 msync done 1713429680.684186 munmap done 000973[0] 1713429680.686515 mapread 0x1c0008 thru 0x1c70af (0x70a8 bytes) 1713429680.686731 mmap done 1713429680.702497 memcpy done 1713429680.703015 munmap done 000974[0] 1713429680.703439 write 0x0c469a thru 0x0ce024 (0x998b bytes) 1713429680.708468 write done 000978[0] 1713429680.741446 write 0x1616cd thru 0x16dc5f (0xc593 bytes) 1713429680.747855 write done 000980[0] 1713429680.766731 trunc from 0x1d6021 to 0x07289c (0x163784 bytes) 1713429680.773198 truncate done 000984[0] 1713429680.798377 write 0x1b36fe thru 0x1b596f (0x2272 bytes) 1713429680.799021 write done 000987[0] 1713429680.808126 mapread 0x111c4c thru 0x11c5ce (0xa983 bytes) 1713429680.808440 mmap done 1713429680.835224 memcpy done 1713429680.835419 munmap done 000988[0] 1713429680.835971 mapread 0x084ef8 thru 0x08a180 (0x5289 bytes) 1713429680.836125 mmap done 1713429680.848407 memcpy done 1713429680.848479 munmap done 000989[1] 1713429680.854304 mapread 0x13f14d thru 0x14cbe3 (0xda97 bytes) 1713429680.857513 mmap done 1713429680.886642 memcpy done 1713429680.886754 munmap done 000990[1] 1713429680.892202 trunc from 0x1b5970 to 0x09501f (0x120950 bytes) 1713429680.904725 truncate done 000994[0] 1713429680.915179 mapwrite 0x0a0885 thru 0x0afdf6 (0xf572 bytes) 1713429680.928364 truncate done 1713429680.928650 mmap done 1713429680.989846 msync done 1713429680.989945 munmap done 000995[1] 1713429680.998688 read 0x030c37 thru 0x039752 (0x8b1c bytes) 1713429681.010081 read done 000998[1] 1713429681.028593 write 0x033fba thru 0x037d39 (0x3d80 bytes) 1713429681.038461 write done 001000[0] 1713429681.051819 write 0x1c9e7d thru 0x1ceb68 (0x4cec bytes) 1713429681.052996 write done All operations completed A-OK! PASS fsx (16s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 04:41:24 (1713429684) excepting tests: 42a 42c 42b 118c 118d 407 411b 130b 130c 130d 130e 130f 130g 312 skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b === sanity: start setup 04:41:28 (1713429688) === Stopping clients: oleg212-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg212-client.virtnet /mnt/lustre2 opts: oleg212-client.virtnet: executing check_config_client /mnt/lustre oleg212-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg212-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b5c8e000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c8e000.idle_timeout=debug disable quota as required oleg212-server: oleg212-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 04:41:35 (1713429695) === running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f14929] preparing for tests involving mounts mke2fs 1.46.2.wc5 (26-Mar-2022) debug=all debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36a: MDS utime check (mknod, utime) ======= 04:41:37 (1713429697) utime: good mknod times 1713429697 <= 1713429698 <= 1713429698 for /mnt/lustre/f36 utime: good utime mtimes 100000, atime 200000 PASS 36a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36b: OST utime check (open, utime) ======== 04:41:41 (1713429701) utime: good utime mtimes 100000, atime 200000 PASS 36b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36c: non-root MDS utime check (mknod, utime) ========================================================== 04:41:44 (1713429704) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good mknod times 1713429704 <= 1713429705 <= 1713429705 for /mnt/lustre/d36/f36 utime: good utime mtimes 100000, atime 200000 PASS 36c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36d: non-root OST utime check (open, utime) ========================================================== 04:41:48 (1713429708) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36/f36] utime: good utime mtimes 100000, atime 200000 PASS 36d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36e: utime on non-owned file (should return error) ========================================================== 04:41:52 (1713429712) running as uid/gid/euid/egid 500/500/500/500, groups: [utime] [/mnt/lustre/d36e.sanity/f36e.sanity] utime: utime(/mnt/lustre/d36e.sanity/f36e.sanity) failed: rc 1: Operation not permitted PASS 36e (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36f: utime on file racing with OST BRW write ==================================================================== 04:41:55 (1713429715) fail_loc=0x80000214 Thu Apr 18 04:41:55 EDT 2024 1713429715 Thu Apr 18 04:41:56 EDT 2024 1713429716 PASS 36f (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36g: FMD cache expiry =============================================================================== 04:41:59 (1713429719) FMD max age: 30s FMD before: 6 FMD after: 0 PASS 36g (45s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36h: utime on file racing with OST BRW write ==================================================================== 04:42:46 (1713429766) fail_loc=0x80000227 Thu Apr 18 04:42:46 EDT 2024 1713429766 Thu Apr 18 04:42:47 EDT 2024 1713429767 PASS 36h (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 36i: change mtime on striped directory ==== 04:42:50 (1713429770) SKIP: sanity test_36i needs >= 2 MDTs SKIP 36i (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39a: mtime changed on create ============== 04:42:53 (1713429773) Succeed in opening file "/mnt/lustre/f39a.sanity2"(flags=O_CREAT) PASS 39a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39b: mtime change on open, link, unlink, rename ================================================================ 04:42:58 (1713429778) repeat after cancel_lru_locks PASS 39b (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39c: mtime change on rename ===================================================================================== 04:43:03 (1713429783) repeat after cancel_lru_locks PASS 39c (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39d: create, utime, stat ======================================================================================== 04:43:09 (1713429789) repeat after cancel_lru_locks PASS 39d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39e: create, stat, utime, stat ================================================================================== 04:43:13 (1713429793) repeat after cancel_lru_locks PASS 39e (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39f: create, stat, sleep, utime, stat =========================================================================== 04:43:17 (1713429797) repeat after cancel_lru_locks PASS 39f (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39g: write, chmod, stat ========================================================================================= 04:43:22 (1713429802) repeat after cancel_lru_locks PASS 39g (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39h: write, utime within one second, stat ======================================================================= 04:43:28 (1713429808) repeat after cancel_lru_locks PASS 39h (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39i: write, rename, stat ======================================================================================== 04:43:32 (1713429812) repeat after cancel_lru_locks PASS 39i (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39j: write, rename, close, stat ================================================================================= 04:43:37 (1713429817) debug=-1 debug_mb=150 debug=-1 debug_mb=150 fail_loc=0x80000412 multiop /mnt/lustre/f39j.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14929 repeat after cancel_lru_locks fail_loc=0 debug_mb=21 debug_mb=21 debug=trace inode super iotrace malloc cache info ioctl neterror net warning buffs other dentry nettrace page dlmtrace error emerg ha rpctrace vfstrace reada mmap config console quota sec lfsck hsm snapshot layout debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS 39j (5s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39k: write, utime, close, stat ================================================================================== 04:43:44 (1713429824) multiop /mnt/lustre/f39k.sanity voO_RDWR:w2097152_c TMPPIPE=/tmp/multiop_open_wait_pipe.14929 repeat after cancel_lru_locks PASS 39k (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39l: directory atime update ===================================================================================== 04:43:49 (1713429829) PASS 39l (9s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39m: test atime and mtime before 1970 ===== 04:44:00 (1713429840) repeat after cancel_lru_locks PASS 39m (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39n: check that O_NOATIME is honored ====== 04:44:06 (1713429846) 1+0 records in 1+0 records out PASS 39n (13s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39o: directory cached attributes updated after create ========================================================== 04:44:21 (1713429861) a b PASS 39o (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39p: remote directory cached attributes updated after create ================================================================== 04:44:24 (1713429864) SKIP: sanity test_39p needs >= 2 MDTs SKIP 39p (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39r: lazy atime update on OST ============= 04:44:27 (1713429867) SKIP: sanity test_39r ldiskfs only test SKIP 39r (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39q: close won't zero out atime =========== 04:44:29 (1713429869) multiop /mnt/lustre/d39q.sanity vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.14929 PASS 39q (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 39s: relatime is supported ================ 04:44:33 (1713429873) 192.168.202.112@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg212-client.virtnet /mnt/lustre (opts:) Starting client: oleg212-client.virtnet: -o relatime oleg212-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out Stopping client oleg212-client.virtnet /mnt/lustre (opts:) Starting client: oleg212-client.virtnet: -o user_xattr,flock oleg212-server@tcp:/lustre /mnt/lustre PASS 39s (7s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 40: failed open(O_TRUNC) doesn't truncate ======================================================================= 04:44:42 (1713429882) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00407993 s, 1.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [openfile] [-f] [O_WRONLY:O_TRUNC] [/mnt/lustre/f40.sanity] Error in opening file "/mnt/lustre/f40.sanity"(flags=O_WRONLY) 13: Permission denied /mnt/lustre/f40.sanity has type file OK /mnt/lustre/f40.sanity has size 4096 OK PASS 40 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 41: test small file write + fstat =============================================================================== 04:44:46 (1713429886) First String: abcdefghijklmnopqr Second String: abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr abcdefghiabcdefghijklmnopqr Pass! PASS 41 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 42d: test complete truncate of file with cached dirty data ========================================================== 04:44:50 (1713429890) debug=+cache vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 100+0 records in 100+0 records out 102400 bytes (102 kB) copied, 0.0268855 s, 3.8 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6144 2200960 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7530496 1% /mnt/lustre pass grant check: client:6815744 server:6815744 PASS 42d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 42e: verify sub-RPC writes are not done synchronously ========================================================== 04:44:54 (1713429894) total: 1000 open/close in 3.57 seconds: 280.13 ops/second total: 934 open/close in 3.06 seconds: 304.75 ops/second 1+0 records in 1+0 records out 489684992 bytes (490 MB) copied, 13.8564 s, 35.3 MB/s osc.lustre-OST0000-osc-ffff8800b6121800.cur_dirty_bytes=0 osc.lustre-OST0000-osc-ffff8800b6121800.cur_grant_bytes=490340352 osc.lustre-OST0000-osc-ffff8800b6121800.cur_dirty_bytes=1048576 osc.lustre-OST0000-osc-ffff8800b6121800.cur_grant_bytes=489422848 osc.lustre-OST0000-osc-ffff8800b6121800.rpc_stats=0 osc.lustre-OST0000-osc-ffff8800b6121800.rpc_stats= snapshot_time: 1713429954.965962940 secs.nsecs start_time: 1713429952.096646172 secs.nsecs elapsed_time: 2.869316768 secs.nsecs read RPCs in flight: 0 write RPCs in flight: 0 pending write pages: 0 pending read pages: 0 read write pages per rpc rpcs % cum % | rpcs % cum % 1: 0 0 0 | 0 0 0 2: 0 0 0 | 0 0 0 4: 0 0 0 | 0 0 0 8: 0 0 0 | 0 0 0 16: 0 0 0 | 33 100 100 read write rpcs in flight rpcs % cum % | rpcs % cum % 1: 0 0 0 | 33 100 100 read write offset rpcs % cum % | rpcs % cum % 0: 0 0 0 | 33 100 100 checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 6784 2201856 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 112640 3656704 3% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 116736 7421952 2% /mnt/lustre pass grant check: client:493748224 server:493748224 PASS 42e (75s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43A: execution of file opened for write should return -ETXTBSY ========================================================== 04:46:11 (1713429971) /home/green/git/lustre-release/lustre/tests/sanity.sh: line 5690: /mnt/lustre/d43A.sanity/f43A.sanity: Text file busy PASS 43A (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43a: open(RDWR) of file being executed should return -ETXTBSY ========================================================== 04:46:15 (1713429975) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4697: 11143 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43b: truncate of file being executed should return -ETXTBSY ========================================================== 04:46:20 (1713429980) truncate: cannot truncate '/mnt/lustre/d43b.sanity/sleep' to length 0: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4697: 11882 Terminated $DIR/$tdir/sleep 60 (wd: ~) PASS 43b (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 43c: md5sum of copy into lustre =========== 04:46:24 (1713429984) bash: OK PASS 43c (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 46: dirtying a previously written page ========================================================================== 04:46:28 (1713429988) vm.dirty_writeback_centisecs = 0 vm.dirty_writeback_centisecs = 0 vm.dirty_ratio = 50 vm.dirty_background_ratio = 25 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.003861 s, 1.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00136846 s, 3.0 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00121687 s, 3.4 MB/s vm.dirty_writeback_centisecs = 500 vm.dirty_background_ratio = 10 vm.dirty_ratio = 20 PASS 46 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 56r: check lfs find -size works =========== 04:46:32 (1713429992) PASS 56r (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 101e: check read-ahead for small read(1k) for small files(500k) ========================================================== 04:46:37 (1713429997) Creating 100 500K test files Cancel LRU locks on lustre client to flush the client cache Reset readahead stats llite.lustre-ffff8800b6121800.max_cached_mb= users: 5 max_cached_mb: 1865 used_mb: 49 unused_mb: 1816 reclaim_count: 0 max_read_ahead_mb: 256 used_read_ahead_mb: 0 llite.lustre-ffff8800b6121800.read_ahead_stats= snapshot_time 1713430018.858693612 secs.nsecs start_time 1713430011.824774289 secs.nsecs elapsed_time 7.033919323 secs.nsecs hits 12300 samples [pages] misses 200 samples [pages] zero_size_window 100 samples [pages] failed_to_fast_read 200 samples [pages] readahead_pages 100 samples [pages] 123 123 12300 PASS 101e (25s) debug_raw_pointers=1 debug_raw_pointers=1 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 resend_count is set to 4 4 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 119a: Short directIO read must return actual read amount ========================================================== 04:47:04 (1713430024) directio on /mnt/lustre/f119a.sanity for 1x524288 bytes PASS PASS 119a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131a: test iov's crossing stripe boundary for writev/readv ========================================================== 04:47:08 (1713430028) PASS 131a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131b: test append writev ================== 04:47:12 (1713430032) /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 3145728 OK /mnt/lustre/f131b.sanity has type file OK /mnt/lustre/f131b.sanity has size 5767168 OK PASS 131b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131c: test read/write on file w/o objects ========================================================== 04:47:16 (1713430036) Write error: Bad file descriptor (rc = -1, len = 1048576) PASS 131c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131d: test short read ===================== 04:47:20 (1713430040) PASS 131d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 131e: test read hitting hole ============== 04:47:23 (1713430043) PASS 131e (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150a: truncate/append tests =============== 04:47:27 (1713430047) 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00030007 s, 20.3 MB/s Stopping client oleg212-client.virtnet /mnt/lustre (opts:) Starting client: oleg212-client.virtnet: -o user_xattr,flock oleg212-server@tcp:/lustre /mnt/lustre Filesystem 1024-blocks Used Available Capacity Mounted on 192.168.202.112@tcp:/lustre 7542784 8192 7530496 1% /mnt/lustre sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete PASS 150a (18s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150b: Verify fallocate (prealloc) functionality ========================================================== 04:47:47 (1713430067) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150b need >= 2.13.57 and ldiskfs for fallocate SKIP 150b (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150bb: Verify fallocate modes both zero space ========================================================== 04:47:50 (1713430070) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150bb need >= 2.13.57 and ldiskfs for fallocate SKIP 150bb (0s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150c: Verify fallocate Size and Blocks ==== 04:47:52 (1713430072) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150c need >= 2.13.57 and ldiskfs for fallocate SKIP 150c (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150d: Verify fallocate Size and Blocks - Non zero start ========================================================== 04:47:55 (1713430075) fallocate on zfs doesn't consume space fallocate not supported SKIP: sanity test_150d need >= 2.13.57 and ldiskfs for fallocate SKIP 150d (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150f: Verify fallocate punch functionality ========================================================== 04:47:58 (1713430078) SKIP: sanity test_150f LU-14160: punch mode is not implemented on OSD ZFS SKIP 150f (0s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 150g: Verify fallocate punch on large range ========================================================== 04:48:00 (1713430080) SKIP: sanity test_150g LU-14160: punch mode is not implemented on OSD ZFS SKIP 150g (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155a: Verify small file correctness: read cache:on write_cache:on ========================================================== 04:48:03 (1713430083) oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.00084333 s, 7.2 MB/s oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 PASS 155a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155b: Verify small file correctness: read cache:on write_cache:off ========================================================== 04:48:08 (1713430088) oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='1': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000262301 s, 23.2 MB/s oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 PASS 155b (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155c: Verify small file correctness: read cache:off write_cache:on ========================================================== 04:48:13 (1713430093) oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='1': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000284422 s, 21.4 MB/s oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 PASS 155c (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 155d: Verify small file correctness: read cache:off write_cache:off ========================================================== 04:48:18 (1713430098) oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: get_param: param_path 'osd-*/*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/read_cache_enable'='0': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 oleg212-server: error: set_param: param_path 'osd-*/lustre-OST*/writethrough_cache_enable': No such file or directory oleg212-server: error: set_param: setting 'osd-*/lustre-OST*/writethrough_cache_enable'='0': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 1+0 records in 1+0 records out 6096 bytes (6.1 kB) copied, 0.000358022 s, 17.0 MB/s oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 oleg212-server: error: set_param: setting : Invalid argument pdsh@oleg212-client: oleg212-server: ssh exited with exit code 22 PASS 155d (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 207a: can refresh layout at glimpse ======= 04:48:24 (1713430104) 7+0 records in 7+0 records out 28672 bytes (29 kB) copied, 0.00655841 s, 4.4 MB/s fail_loc=0x170 PASS 207a (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 207b: can refresh layout at open ========== 04:48:27 (1713430107) 8+0 records in 8+0 records out 32768 bytes (33 kB) copied, 0.00861373 s, 3.8 MB/s fail_loc=0x171 checksum is bb7df04e1b0a2570657527a7e108ae23 /mnt/lustre/f207b.sanity PASS 207b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 241a: bio vs dio ========================== 04:48:31 (1713430111) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00394002 s, 10.4 MB/s -rw-r--r-- 1 root root 40960 Apr 18 04:48 /mnt/lustre/f241a.sanity ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=3 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=2 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 ldlm.namespaces.lustre-MDT0000-mdc-ffff88007c5e0800.lock_unused_count=1 PASS 241a (19s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 241b: dio vs dio ========================== 04:48:51 (1713430131) 1+0 records in 1+0 records out 40960 bytes (41 kB) copied, 0.00301165 s, 13.6 MB/s -rw-r--r-- 1 root root 40960 Apr 18 04:48 /mnt/lustre/f241b.sanity PASS 241b (10s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 251a: Handling short read and write correctly ========================================================== 04:49:03 (1713430143) fail_loc=0xa0001407 fail_val=1 fail_loc=0xa0001407 fail_val=1 PASS 251a (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanity test 251b: short read restore offset correctly ========================================================== 04:49:06 (1713430146) 4+0 records in 4+0 records out 4096 bytes (4.1 kB) copied, 0.0029731 s, 1.4 MB/s fail_loc=0x1431 fail_val=5 PASS 251b (7s) debug_raw_pointers=1 debug_raw_pointers=1 == sanity test complete, duration 470 sec ================ 04:49:14 (1713430154) === sanity: start cleanup 04:49:14 (1713430154) === Starting client oleg212-client.virtnet: -o user_xattr,flock oleg212-server@tcp:/lustre /mnt/lustre2 Started clients oleg212-client.virtnet: 192.168.202.112@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) Stopping clients: oleg212-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg212-client.virtnet /mnt/lustre2 opts: === sanity: finish cleanup 04:49:15 (1713430155) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck PASS sanity (472s) debug_raw_pointers=0 debug_raw_pointers=0 debug_raw_pointers=Y debug_raw_pointers=Y == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 04:49:18 (1713430158) excepting tests: 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 04:49:21 (1713430161) === Starting client oleg212-client.virtnet: -o user_xattr,flock oleg212-server@tcp:/lustre /mnt/lustre2 Started clients oleg212-client.virtnet: 192.168.202.112@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg212-client.virtnet: executing check_config_client /mnt/lustre oleg212-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg212-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88007c5e0800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b5c88000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88007c5e0800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b5c88000.idle_timeout=debug disable quota as required oleg212-server: oleg212-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 04:49:28 (1713430168) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112362 s, 93.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f9275] debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 04:49:29 (1713430169) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 04:49:32 (1713430172) -rw-r--r-- 1 root root 0 Apr 18 04:49 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 04:49:36 (1713430176) -rw-r--r-- 1 root root 0 Apr 18 04:49 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 04:49:39 (1713430179) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 04:49:43 (1713430183) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2e: check chmod on root is propagated to others ========================================================== 04:49:46 (1713430186) total 748 -rwxrwxrwx 1 root root 0 Apr 18 04:49 f2a -rwxrwxrwx 1 root root 0 Apr 18 04:49 f2b -rw-r--r-- 1 root root 1895273 Apr 18 04:41 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Apr 18 04:41 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 70983 Apr 18 04:41 ffsx.sanity-dom.fsxlog total 748 -rwxrwxrwx 1 root root 0 Apr 18 04:49 f2a -rwxrwxrwx 1 root root 0 Apr 18 04:49 f2b -rw-r--r-- 1 root root 1895273 Apr 18 04:41 ffsx.sanity-dom -rw-r--r-- 1 root root 0 Apr 18 04:41 ffsx.sanity-dom.fsxgood -rw-r--r-- 1 root root 70983 Apr 18 04:41 ffsx.sanity-dom.fsxlog running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00212932 s, 240 kB/s PASS 2e (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 04:49:49 (1713430189) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 2g: check blocks update on sync write ==== 04:49:52 (1713430192) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.118526 s, 17.7 MB/s /mnt/lustre/f2g.sanityn has 4109 blocks /mnt/lustre2/f2g.sanityn has 4109 blocks PASS 2g (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 4: fstat validation on multiple mount points ==================================================================== 04:49:55 (1713430195) PASS 4 (3s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 04:49:59 (1713430199) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 6: remove of open file on other node ============================================================================ 04:50:03 (1713430203) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 7: remove of open directory on other node ======================================================================= 04:50:06 (1713430206) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 8: remove of open special file on other node ==================================================================== 04:50:10 (1713430210) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 04:50:14 (1713430214) PASS 9a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 9b: append to striped sparse file ======== 04:50:17 (1713430217) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126805 s, 82.7 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.038625 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 04:50:21 (1713430221) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00200659 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00419091 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00376861 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00374592 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00530596 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00393577 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00333033 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00393832 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00543004 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00383878 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00418299 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00356889 s, 0.3 kB/s PASS 10a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 04:50:25 (1713430225) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00419656 s, 732 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0121074 s, 338 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000826808 s, 3.7 MB/s PASS 10b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 11: execution of file opened for write should return error ============================================================== 04:50:29 (1713430229) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.9275 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 04:50:33 (1713430233) warning: '-runtime' deprecated, use '-t runtime' instead - link 1862 (time 1713430243.59 total 10.00 last 186.19) - link 4505 (time 1713430253.59 total 20.00 last 264.24) - link 7011 (time 1713430263.59 total 30.01 last 250.53) - link 9450 (time 1713430273.59 total 40.01 last 243.87) - link 10000 (time 1713430276.08 total 42.49 last 221.11) - link 12366 (time 1713430286.08 total 52.50 last 236.53) - link 14381 (time 1713430296.09 total 62.50 last 201.43) - link 16163 (time 1713430306.09 total 72.50 last 178.17) - link 18027 (time 1713430316.09 total 82.51 last 186.32) - link 20000 (time 1713430326.01 total 92.43 last 198.89) total: 22032 link in 100.00 seconds: 220.32 ops/second using seed 3525055068 running for 100 seconds - stat 2218 (time 1713430245 ; total 11 ; last 11) - stat 10000 (time 1713430254 ; total 20 ; last 9) - stat 18414 (time 1713430265 ; total 31 ; last 11) - stat 20000 (time 1713430266 ; total 32 ; last 1) - stat 28135 (time 1713430277 ; total 43 ; last 11) - stat 30000 (time 1713430279 ; total 45 ; last 2) - stat 36263 (time 1713430290 ; total 56 ; last 11) - stat 40000 (time 1713430298 ; total 64 ; last 8) - stat 43807 (time 1713430309 ; total 75 ; last 11) - stat 48316 (time 1713430320 ; total 86 ; last 11) - stat 50000 (time 1713430323 ; total 89 ; last 3) - stat 54908 (time 1713430334 ; total 100 ; last 11) total: 54909 stats in 100 seconds: 549.090027 stats/second - unlinked 0 (time 1713430284 ; total 0 ; last 0) - unlinked 10000 (time 1713430349 ; total 65 ; last 65) - unlinked 20000 (time 1713430378 ; total 94 ; last 29) unlink(/mnt/lustre2/lockdir/lockfile22032) error: No such file or directory total: 22031 unlinks in 101 seconds: 218.128708 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (24216) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (24219) - No such process PASS 12 (153s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 04:53:08 (1713430388) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.9275 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4697: 25081 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 04:53:11 (1713430391) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4697: 25820 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 04:53:14 (1713430394) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 26557 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 04:53:18 (1713430398) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 27297 Terminated $DIR1/$tdir/sleep 60 PASS 14c (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 14d: chmod of executing file is still possible ================================================================== 04:53:21 (1713430401) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 28036 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 17: resource creation/LVB creation race ========================================================================= 04:53:25 (1713430405) fail_loc=0x8000030a PASS 17 (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 19: test concurrent uncached read races ========================================================================= 04:53:31 (1713430411) oleg212-server: error: get_param: param_path 'osd-*/lustre-MDT*/read_cache_enable': No such file or directory pdsh@oleg212-client: oleg212-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 20: test extra readahead page left in cache ============================================================== 04:53:33 (1713430413) PASS 20 (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 23: others should see updated atime while another read============================================================== 04:53:36 (1713430416) now is 1713430417 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.9275 new atime is 1713430478 PASS 23 (63s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 27: align non-overlapping extent locks from request ============================================================= 04:54:41 (1713430481) 4+0 records in 4+0 records out 16793600 bytes (17 MB) copied, 0.117873 s, 142 MB/s dd 1 started dd 2 started 1+0 records in 1+0 records out 15728640 bytes (16 MB) copied, 0.173694 s, 90.6 MB/s 1+0 records in 1+0 records out 8192 bytes (8.2 kB) copied, 0.0032882 s, 2.5 MB/s dd 3 finished PASS 27 (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39a: file mtime does not change after rename ========================================================== 04:54:46 (1713430486) repeat after cancel_lru_locks PASS 39a (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 04:54:50 (1713430490) repeat after cancel_lru_locks PASS 39b (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39c: check truncate mtime update ================================================================================ 04:54:54 (1713430494) repeat after cancel_lru_locks PASS 39c (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 39d: sync write should update mtime ====== 04:54:58 (1713430498) fail_loc=0x411 fail_loc=0 PASS 39d (1s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 51a: layout lock: refresh layout should work ========================================================== 04:55:01 (1713430501) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00459311 s, 34.6 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3445: kill: (3681) - No such process PASS 51a (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 04:55:06 (1713430506) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.005541 s, 185 kB/s PASS 51c (6s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 04:55:14 (1713430514) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00745285 s, 141 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (2s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 107a: Basic grouplock conflict =========== 04:55:18 (1713430518) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0680568 s, 154 MB/s /mnt/lustre/f107a.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x280000400:0x3db:0x0] } multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.9275 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.9275 First grouplock blocks second one PASS 107a (4s) debug_raw_pointers=1 debug_raw_pointers=1 debug_raw_pointers=Y debug_raw_pointers=Y == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 04:55:23 (1713430523) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0951006 s, 110 MB/s /mnt/lustre/f107b.sanityn lcm_layout_gen: 3 lcm_mirror_count: 1 lcm_entry_count: 2 lcme_id: 1 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: 1048576 lmm_stripe_count: 0 lmm_stripe_size: 1048576 lmm_pattern: mdt lmm_layout_gen: 0 lmm_stripe_offset: 0 lcme_id: 2 lcme_mirror_id: 0 lcme_flags: init lcme_extent.e_start: 1048576 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x240000400:0x3dd:0x0] } multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.9275 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) debug_raw_pointers=1 debug_raw_pointers=1 cleanup: ====================================================== == sanityn test complete, duration 374 sec =============== 04:55:32 (1713430532) === sanityn: start cleanup 04:55:32 (1713430532) === Stopping clients: oleg212-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg212-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 04:55:33 (1713430533) === PASS sanityn (376s) debug_raw_pointers=0 debug_raw_pointers=0 == sanity-dom test complete, duration 911 sec ============ 04:55:34 (1713430534) === sanity-dom: start cleanup 04:55:35 (1713430535) === Stopping clients: oleg212-client.virtnet /mnt/lustre2 (opts:) === sanity-dom: finish cleanup 04:55:35 (1713430535) ===