== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 07:07:29 (1713438449) start mds service on oleg110-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg110-server' oleg110-server: oleg110-server.virtnet: executing load_modules_local oleg110-server: Loading modules from /home/green/git/lustre-release/lustre oleg110-server: detected 4 online CPUs by sysfs oleg110-server: Force libcfs to create 2 CPU partitions oleg110-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg110-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg110-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg110-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg110-server: oleg110-server.virtnet: executing set_default_debug -1 all pdsh@oleg110-client: oleg110-server: ssh exited with exit code 1 Started lustre-OST0000 oleg110-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg110-client.virtnet: -o user_xattr,flock oleg110-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 811 (time 1713438483.66 total 10.56 last 76.81) - open/close 1660 (time 1713438494.26 total 21.16 last 80.06) - open/close 2355 (time 1713438504.57 total 31.47 last 67.44) - open/close 3036 (time 1713438514.98 total 41.88 last 65.41) - open/close 3612 (time 1713438525.18 total 52.08 last 56.48) - open/close 4137 (time 1713438535.31 total 62.21 last 51.81) - open/close 4869 (time 1713438545.82 total 72.72 last 69.68) - open/close 5449 (time 1713438555.92 total 82.82 last 57.43) - open/close 6262 (time 1713438566.50 total 93.40 last 76.85) - open/close 6845 (time 1713438577.04 total 103.94 last 55.31) - open/close 7369 (time 1713438587.45 total 114.35 last 50.31) - open/close 8162 (time 1713438598.11 total 125.01 last 74.39) - open/close 8704 (time 1713438608.47 total 135.37 last 52.32) - open/close 9215 (time 1713438618.75 total 145.65 last 49.69) - open/close 9575 (time 1713438630.99 total 157.89 last 29.43) - open/close 10000 (time 1713438637.06 total 163.96 last 69.97) - open/close 10518 (time 1713438647.13 total 174.03 last 51.45) - open/close 11098 (time 1713438657.35 total 184.25 last 56.74) - open/close 11776 (time 1713438667.69 total 194.59 last 65.59) - open/close 12336 (time 1713438682.32 total 209.22 last 38.26) - open/close 12830 (time 1713438692.82 total 219.72 last 47.03) - open/close 13306 (time 1713438702.94 total 229.84 last 47.04) - open/close 13922 (time 1713438713.26 total 240.16 last 59.69) - open/close 14648 (time 1713438723.74 total 250.64 last 69.32) - open/close 17788 (time 1713438733.74 total 260.64 last 313.98) - open/close 20000 (time 1713438739.26 total 266.16 last 400.81) - open/close 24803 (time 1713438749.26 total 276.16 last 480.24) - open/close 29821 (time 1713438759.26 total 286.16 last 501.70) - open/close 34733 (time 1713438769.26 total 296.16 last 491.12) - open/close 39422 (time 1713438779.26 total 306.16 last 468.90) - open/close 44690 (time 1713438789.26 total 316.16 last 526.77) - open/close 49388 (time 1713438799.26 total 326.16 last 469.70) total: 50000 open/close in 328.09 seconds: 152.40 ops/second - unlinked 0 (time 1713438802 ; total 0 ; last 0) - unlinked 10000 (time 1713438814 ; total 12 ; last 12) - unlinked 20000 (time 1713438826 ; total 24 ; last 12) - unlinked 30000 (time 1713438838 ; total 36 ; last 12) - unlinked 40000 (time 1713438849 ; total 47 ; last 11) total: 50000 unlinks in 62 seconds: 806.451599 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg110-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg110-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg110-server stop mds service on oleg110-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg110-server unloading modules on: 'oleg110-server' oleg110-server: oleg110-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg110-client: oleg110-client: ssh exited with exit code 2 pdsh@oleg110-client: oleg110-server: ssh exited with exit code 2 pdsh@oleg110-client: oleg110-client: ssh exited with exit code 2 pdsh@oleg110-client: oleg110-server: ssh exited with exit code 2