== conf-sanity test 101a: Race MDT->OST reconnection with create ========================================================== 11:10:23 (1713280223) start mds service on oleg413-server Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg413-server' oleg413-server: oleg413-server.virtnet: executing load_modules_local oleg413-server: Loading modules from /home/green/git/lustre-release/lustre oleg413-server: detected 4 online CPUs by sysfs oleg413-server: Force libcfs to create 2 CPU partitions oleg413-server: ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' oleg413-server: quota/lquota options: 'hash_lqs_cur_bits=3' Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1 Started lustre-MDT0000 oleg413-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid start ost1 service on oleg413-server Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg413-server: oleg413-server.virtnet: executing set_default_debug -1 all pdsh@oleg413-client: oleg413-server: ssh exited with exit code 1 Started lustre-OST0000 oleg413-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid mount lustre on /mnt/lustre..... Starting client: oleg413-client.virtnet: -o user_xattr,flock oleg413-server@tcp:/lustre /mnt/lustre seq.cli-lustre-OST0000-super.width=0x1ffffff - open/close 222 (time 1713280263.49 total 10.92 last 20.33) - open/close 485 (time 1713280273.49 total 20.92 last 26.30) - open/close 665 (time 1713280284.06 total 31.49 last 17.03) - open/close 1021 (time 1713280294.28 total 41.71 last 34.84) - open/close 1246 (time 1713280305.17 total 52.59 last 20.67) - open/close 1548 (time 1713280315.26 total 62.69 last 29.92) - open/close 1722 (time 1713280325.99 total 73.41 last 16.22) - open/close 2071 (time 1713280336.20 total 83.62 last 34.18) - open/close 2319 (time 1713280347.20 total 94.62 last 22.54) - open/close 2392 (time 1713280357.53 total 104.96 last 7.06) - open/close 2637 (time 1713280367.54 total 114.96 last 24.49) - open/close 2974 (time 1713280377.86 total 125.28 last 32.65) - open/close 3081 (time 1713280388.30 total 135.73 last 10.24) - open/close 3404 (time 1713280398.47 total 145.89 last 31.77) - open/close 3609 (time 1713280411.31 total 158.74 last 15.96) - open/close 3932 (time 1713280421.46 total 168.88 last 31.83) - open/close 4295 (time 1713280431.78 total 179.20 last 35.18) - open/close 4690 (time 1713280441.78 total 189.20 last 39.50) - open/close 5217 (time 1713280451.82 total 199.25 last 52.46) - open/close 5410 (time 1713280462.62 total 210.04 last 17.88) - open/close 5955 (time 1713280473.08 total 220.51 last 52.08) - open/close 6367 (time 1713280483.24 total 230.67 last 40.55) - open/close 6683 (time 1713280493.33 total 240.76 last 31.32) - open/close 6968 (time 1713280503.50 total 250.93 last 28.03) - open/close 7087 (time 1713280514.01 total 261.44 last 11.32) - open/close 7495 (time 1713280524.67 total 272.09 last 38.30) - open/close 7656 (time 1713280535.32 total 282.75 last 15.11) - open/close 7988 (time 1713280545.64 total 293.07 last 32.16) - open/close 8309 (time 1713280555.98 total 303.40 last 31.06) - open/close 8364 (time 1713280566.21 total 313.64 last 5.37) - open/close 8925 (time 1713280576.21 total 323.64 last 56.10) - open/close 10000 (time 1713280580.40 total 327.82 last 256.73) - open/close 12462 (time 1713280590.40 total 337.83 last 246.17) - open/close 15025 (time 1713280600.40 total 347.83 last 256.22) - open/close 17733 (time 1713280610.41 total 357.83 last 270.74) - open/close 20000 (time 1713280619.11 total 366.53 last 260.60) - open/close 22804 (time 1713280629.11 total 376.53 last 280.35) - open/close 25351 (time 1713280639.11 total 386.53 last 254.66) - open/close 27879 (time 1713280649.11 total 396.54 last 252.71) - open/close 30000 (time 1713280657.37 total 404.79 last 256.94) - open/close 32526 (time 1713280667.37 total 414.80 last 252.51) - open/close 35250 (time 1713280677.37 total 424.80 last 272.33) - open/close 37738 (time 1713280687.38 total 434.80 last 248.73) - open/close 40000 (time 1713280696.40 total 443.82 last 250.72) - open/close 42481 (time 1713280706.40 total 453.83 last 248.05) - open/close 44991 (time 1713280716.40 total 463.83 last 251.00) - open/close 47725 (time 1713280726.40 total 473.83 last 273.36) total: 50000 open/close in 480.85 seconds: 103.98 ops/second - unlinked 0 (time 1713280734 ; total 0 ; last 0) - unlinked 10000 (time 1713280755 ; total 21 ; last 21) - unlinked 20000 (time 1713280776 ; total 42 ; last 21) - unlinked 30000 (time 1713280798 ; total 64 ; last 22) - unlinked 40000 (time 1713280819 ; total 85 ; last 21) total: 50000 unlinks in 107 seconds: 467.289734 unlinks/second umount lustre on /mnt/lustre..... Stopping client oleg413-client.virtnet /mnt/lustre (opts:) stop ost1 service on oleg413-server Stopping /mnt/lustre-ost1 (opts:-f) on oleg413-server stop mds service on oleg413-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg413-server unloading modules on: 'oleg413-server' oleg413-server: oleg413-server.virtnet: executing unload_modules_local modules unloaded. pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2 pdsh@oleg413-client: oleg413-client: ssh exited with exit code 2 pdsh@oleg413-client: oleg413-client: ssh exited with exit code 2 pdsh@oleg413-client: oleg413-server: ssh exited with exit code 2